[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260807 13:31:34.378012 3823 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.187.254:40561
I20260807 13:31:34.380524 3823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 13:31:34.381960 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:31:34.411755 3832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:31:34.412153 3833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:31:34.412591 3836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:31:34.414628 3823 server_base.cc:1034] running on GCE node
I20260807 13:31:35.747781 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:31:35.748021 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:31:35.748176 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109495748156 us; error 0 us; skew 500 ppm
I20260807 13:31:35.749239 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:31:35.764974 3823 webserver.cc:460] Webserver started at http://127.3.187.254:36925/ using document root <none> and password file <none>
I20260807 13:31:35.766369 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:31:35.766574 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:31:35.767253 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:31:35.774919 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/master-0-root/instance:
uuid: "d71e2d21b7db43a9bac0cb7366b53af6"
format_stamp: "Formatted at 2026-08-07 13:31:35 on dist-test-slave-d17x"
I20260807 13:31:35.786442 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.006s sys 0.005s
I20260807 13:31:35.794555 3843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:31:35.796039 3823 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.007s sys 0.000s
I20260807 13:31:35.796418 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/master-0-root
uuid: "d71e2d21b7db43a9bac0cb7366b53af6"
format_stamp: "Formatted at 2026-08-07 13:31:35 on dist-test-slave-d17x"
I20260807 13:31:35.796747 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:31:35.867182 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:31:35.869633 3823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 13:31:35.870208 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:31:36.110709 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.254:40561
I20260807 13:31:36.110836 3911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.254:40561 every 8 connection(s)
I20260807 13:31:36.126598 3912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:36.168300 3912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6: Bootstrap starting.
I20260807 13:31:36.180356 3912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:36.183832 3912 log.cc:824] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6: Log is configured to *not* fsync() on all Append() calls
I20260807 13:31:36.192025 3912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6: No bootstrap required, opened a new log
I20260807 13:31:36.229858 3912 raft_consensus.cc:348] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71e2d21b7db43a9bac0cb7366b53af6" member_type: VOTER }
I20260807 13:31:36.230830 3912 raft_consensus.cc:374] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:36.231285 3912 raft_consensus.cc:729] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d71e2d21b7db43a9bac0cb7366b53af6, State: Initialized, Role: FOLLOWER
I20260807 13:31:36.232810 3912 consensus_queue.cc:260] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71e2d21b7db43a9bac0cb7366b53af6" member_type: VOTER }
I20260807 13:31:36.233726 3912 raft_consensus.cc:388] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:31:36.234229 3912 raft_consensus.cc:482] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:31:36.234748 3912 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:36.241853 3912 raft_consensus.cc:504] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71e2d21b7db43a9bac0cb7366b53af6" member_type: VOTER }
I20260807 13:31:36.243112 3912 leader_election.cc:302] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d71e2d21b7db43a9bac0cb7366b53af6; no voters:
I20260807 13:31:36.248404 3912 leader_election.cc:288] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:31:36.248941 3916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:36.258570 3916 raft_consensus.cc:686] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 1 LEADER]: Becoming Leader. State: Replica: d71e2d21b7db43a9bac0cb7366b53af6, State: Running, Role: LEADER
I20260807 13:31:36.260444 3916 consensus_queue.cc:237] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71e2d21b7db43a9bac0cb7366b53af6" member_type: VOTER }
I20260807 13:31:36.262926 3912 sys_catalog.cc:564] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:31:36.290172 3917 sys_catalog.cc:455] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d71e2d21b7db43a9bac0cb7366b53af6. Latest consensus state: current_term: 1 leader_uuid: "d71e2d21b7db43a9bac0cb7366b53af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71e2d21b7db43a9bac0cb7366b53af6" member_type: VOTER } }
I20260807 13:31:36.293931 3917 sys_catalog.cc:458] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [sys.catalog]: This master's current role is: LEADER
I20260807 13:31:36.292833 3918 sys_catalog.cc:455] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d71e2d21b7db43a9bac0cb7366b53af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d71e2d21b7db43a9bac0cb7366b53af6" member_type: VOTER } }
I20260807 13:31:36.295939 3918 sys_catalog.cc:458] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [sys.catalog]: This master's current role is: LEADER
I20260807 13:31:36.308924 3929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 13:31:36.339234 3929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 13:31:36.351351 3823 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 13:31:36.372197 3929 catalog_manager.cc:1347] Generated new cluster ID: a50cf075b6684f41aac94ed5ff2fe15e
I20260807 13:31:36.372483 3929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 13:31:36.396360 3929 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 13:31:36.399080 3929 catalog_manager.cc:1504] Loading token signing keys...
I20260807 13:31:36.419061 3929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6: Generated new TSK 0
I20260807 13:31:36.420481 3929 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 13:31:36.482856 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:31:36.500767 3943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:31:36.504927 3944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:31:36.518299 3823 server_base.cc:1034] running on GCE node
W20260807 13:31:36.520102 3946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:31:36.521234 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:31:36.521476 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:31:36.521669 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109496521652 us; error 0 us; skew 500 ppm
I20260807 13:31:36.522349 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:31:36.530910 3823 webserver.cc:460] Webserver started at http://127.3.187.193:43603/ using document root <none> and password file <none>
I20260807 13:31:36.531641 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:31:36.531885 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:31:36.532226 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:31:36.533656 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-0-root/instance:
uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
format_stamp: "Formatted at 2026-08-07 13:31:36 on dist-test-slave-d17x"
I20260807 13:31:36.544552 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.001s sys 0.007s
I20260807 13:31:36.553593 3954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:31:36.554841 3823 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.004s
I20260807 13:31:36.555125 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-0-root
uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
format_stamp: "Formatted at 2026-08-07 13:31:36 on dist-test-slave-d17x"
I20260807 13:31:36.555435 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:31:36.604765 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:31:36.606776 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:31:36.612439 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:31:36.618937 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:31:36.619237 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:31:36.619530 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:31:36.619766 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:31:36.917075 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.193:38213
I20260807 13:31:36.917368 4043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.193:38213 every 8 connection(s)
I20260807 13:31:36.923559 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:31:36.947353 4049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:31:36.950793 4050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:31:36.968679 4054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:31:36.969177 3823 server_base.cc:1034] running on GCE node
I20260807 13:31:36.970541 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:31:36.970845 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:31:36.971077 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109496971061 us; error 0 us; skew 500 ppm
I20260807 13:31:36.971202 4044 heartbeater.cc:347] Connected to a master server at 127.3.187.254:40561
I20260807 13:31:36.971671 4044 heartbeater.cc:464] Registering TS with master...
I20260807 13:31:36.971812 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:31:36.973205 4044 heartbeater.cc:511] Master 127.3.187.254:40561 requested a full tablet report, sending...
I20260807 13:31:36.975507 3823 webserver.cc:460] Webserver started at http://127.3.187.194:34345/ using document root <none> and password file <none>
I20260807 13:31:36.976207 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:31:36.976475 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:31:36.976850 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:31:36.977370 3869 ts_manager.cc:194] Registered new tserver with Master: 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213)
I20260807 13:31:36.978339 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-1-root/instance:
uuid: "ca569eb2b573447f81328411193cfa3b"
format_stamp: "Formatted at 2026-08-07 13:31:36 on dist-test-slave-d17x"
I20260807 13:31:36.980484 3869 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58058
I20260807 13:31:36.985174 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 13:31:36.989974 4059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:31:36.990931 3823 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 13:31:36.991245 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-1-root
uuid: "ca569eb2b573447f81328411193cfa3b"
format_stamp: "Formatted at 2026-08-07 13:31:36 on dist-test-slave-d17x"
I20260807 13:31:36.991583 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:31:37.031080 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:31:37.032765 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:31:37.038905 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:31:37.045519 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:31:37.045848 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:31:37.046132 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:31:37.046332 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 13:31:37.377691 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.194:36523
I20260807 13:31:37.378623 4145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.194:36523 every 8 connection(s)
I20260807 13:31:37.401051 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:31:37.426524 4153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:31:37.429443 4150 heartbeater.cc:347] Connected to a master server at 127.3.187.254:40561
I20260807 13:31:37.430436 4150 heartbeater.cc:464] Registering TS with master...
I20260807 13:31:37.432446 4150 heartbeater.cc:511] Master 127.3.187.254:40561 requested a full tablet report, sending...
W20260807 13:31:37.432722 4154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:31:37.436900 3869 ts_manager.cc:194] Registered new tserver with Master: ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:37.441244 3869 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58074
W20260807 13:31:37.448491 4157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:31:37.451937 3823 server_base.cc:1034] running on GCE node
I20260807 13:31:37.453364 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:31:37.453594 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:31:37.453771 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109497453757 us; error 0 us; skew 500 ppm
I20260807 13:31:37.454365 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:31:37.457160 3823 webserver.cc:460] Webserver started at http://127.3.187.195:44181/ using document root <none> and password file <none>
I20260807 13:31:37.457759 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:31:37.457998 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:31:37.458303 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:31:37.459388 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-2-root/instance:
uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
format_stamp: "Formatted at 2026-08-07 13:31:37 on dist-test-slave-d17x"
I20260807 13:31:37.465765 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 13:31:37.469374 4164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:31:37.470268 3823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 13:31:37.470575 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-2-root
uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
format_stamp: "Formatted at 2026-08-07 13:31:37 on dist-test-slave-d17x"
I20260807 13:31:37.470912 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786109494203502-3823-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:31:37.485098 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:31:37.486702 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:31:37.489590 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:31:37.492303 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:31:37.492543 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:31:37.492803 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:31:37.492993 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:31:37.778759 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.195:39159
I20260807 13:31:37.779706 4253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.195:39159 every 8 connection(s)
I20260807 13:31:37.825347 4254 heartbeater.cc:347] Connected to a master server at 127.3.187.254:40561
I20260807 13:31:37.825974 4254 heartbeater.cc:464] Registering TS with master...
I20260807 13:31:37.827487 4254 heartbeater.cc:511] Master 127.3.187.254:40561 requested a full tablet report, sending...
I20260807 13:31:37.830714 3823 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.031495712s
I20260807 13:31:37.830569 3869 ts_manager.cc:194] Registered new tserver with Master: cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:37.833609 3869 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58088
I20260807 13:31:37.840556 3823 test_util.cc:268] Using random seed: 103158678
I20260807 13:31:38.117611 4044 heartbeater.cc:503] Master 127.3.187.254:40561 was elected leader, sending a full tablet report...
I20260807 13:31:38.187994 3867 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58100:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 13:31:38.196352 3867 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260807 13:31:38.323774 3931 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:31:38.421597 3995 tablet_service.cc:1467] Processing CreateTablet for tablet eeb94ba189e9423d872409088ac4e928 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 13:31:38.436650 3994 tablet_service.cc:1467] Processing CreateTablet for tablet 02900621b4f140998fc2964db01d9c8d (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 13:31:38.436903 3993 tablet_service.cc:1467] Processing CreateTablet for tablet 84cae2afafb44f7282bf39d784f44b5d (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 13:31:38.433959 3991 tablet_service.cc:1467] Processing CreateTablet for tablet 3a65b1f7710a4094a15b7a1239ee20df (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 13:31:38.444386 3995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb94ba189e9423d872409088ac4e928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.441628 3992 tablet_service.cc:1467] Processing CreateTablet for tablet 8767ec640d6c462bbb78cd12f8d77803 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 13:31:38.444866 3989 tablet_service.cc:1467] Processing CreateTablet for tablet 101f669f72414b4b8251ae83a179e212 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 13:31:38.448130 4150 heartbeater.cc:503] Master 127.3.187.254:40561 was elected leader, sending a full tablet report...
I20260807 13:31:38.438983 3990 tablet_service.cc:1467] Processing CreateTablet for tablet fb302e43385b402da2ae60a60aa7d056 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 13:31:38.452266 3987 tablet_service.cc:1467] Processing CreateTablet for tablet 13202f85621849e486b6c76a7dea3195 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 13:31:38.458631 3991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a65b1f7710a4094a15b7a1239ee20df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.459992 3990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb302e43385b402da2ae60a60aa7d056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.450503 3988 tablet_service.cc:1467] Processing CreateTablet for tablet bddc2fa18a784b7db6714c55d11c99de (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 13:31:38.462252 3987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13202f85621849e486b6c76a7dea3195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.470530 3993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84cae2afafb44f7282bf39d784f44b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.472355 3988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bddc2fa18a784b7db6714c55d11c99de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.478204 3992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8767ec640d6c462bbb78cd12f8d77803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.487221 3994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02900621b4f140998fc2964db01d9c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.504482 3989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 101f669f72414b4b8251ae83a179e212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.532495 4101 tablet_service.cc:1467] Processing CreateTablet for tablet 02900621b4f140998fc2964db01d9c8d (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 13:31:38.540223 4102 tablet_service.cc:1467] Processing CreateTablet for tablet eeb94ba189e9423d872409088ac4e928 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 13:31:38.534344 4100 tablet_service.cc:1467] Processing CreateTablet for tablet 84cae2afafb44f7282bf39d784f44b5d (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 13:31:38.552037 4101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02900621b4f140998fc2964db01d9c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.545651 4210 tablet_service.cc:1467] Processing CreateTablet for tablet eeb94ba189e9423d872409088ac4e928 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 13:31:38.566990 4209 tablet_service.cc:1467] Processing CreateTablet for tablet 02900621b4f140998fc2964db01d9c8d (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 13:31:38.566496 4207 tablet_service.cc:1467] Processing CreateTablet for tablet 8767ec640d6c462bbb78cd12f8d77803 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 13:31:38.549454 4099 tablet_service.cc:1467] Processing CreateTablet for tablet 8767ec640d6c462bbb78cd12f8d77803 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 13:31:38.577770 4209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02900621b4f140998fc2964db01d9c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.573071 4208 tablet_service.cc:1467] Processing CreateTablet for tablet 84cae2afafb44f7282bf39d784f44b5d (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 13:31:38.591133 4102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb94ba189e9423d872409088ac4e928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.567045 4098 tablet_service.cc:1467] Processing CreateTablet for tablet 3a65b1f7710a4094a15b7a1239ee20df (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 13:31:38.598785 4207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8767ec640d6c462bbb78cd12f8d77803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.600517 4097 tablet_service.cc:1467] Processing CreateTablet for tablet fb302e43385b402da2ae60a60aa7d056 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 13:31:38.617475 4208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84cae2afafb44f7282bf39d784f44b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.626549 4099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8767ec640d6c462bbb78cd12f8d77803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.631369 4202 tablet_service.cc:1467] Processing CreateTablet for tablet 101f669f72414b4b8251ae83a179e212 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 13:31:38.623378 4204 tablet_service.cc:1467] Processing CreateTablet for tablet 3a65b1f7710a4094a15b7a1239ee20df (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 13:31:38.608414 4203 tablet_service.cc:1467] Processing CreateTablet for tablet fb302e43385b402da2ae60a60aa7d056 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 13:31:38.638888 4096 tablet_service.cc:1467] Processing CreateTablet for tablet 101f669f72414b4b8251ae83a179e212 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 13:31:38.634581 4095 tablet_service.cc:1467] Processing CreateTablet for tablet bddc2fa18a784b7db6714c55d11c99de (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 13:31:38.644726 4210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb94ba189e9423d872409088ac4e928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.646337 4198 tablet_service.cc:1467] Processing CreateTablet for tablet bddc2fa18a784b7db6714c55d11c99de (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 13:31:38.659649 4204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a65b1f7710a4094a15b7a1239ee20df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.659742 4098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a65b1f7710a4094a15b7a1239ee20df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.663370 4203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb302e43385b402da2ae60a60aa7d056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.644222 4093 tablet_service.cc:1467] Processing CreateTablet for tablet 13202f85621849e486b6c76a7dea3195 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 13:31:38.655761 4197 tablet_service.cc:1467] Processing CreateTablet for tablet 13202f85621849e486b6c76a7dea3195 (DEFAULT_TABLE table=test-workload [id=931bbe84aab341e5a2d4d56054e81db7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 13:31:38.668430 4202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 101f669f72414b4b8251ae83a179e212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.675513 4280 tablet_bootstrap.cc:492] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7: Bootstrap starting.
I20260807 13:31:38.680632 4095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bddc2fa18a784b7db6714c55d11c99de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.692353 4093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13202f85621849e486b6c76a7dea3195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.690763 4198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bddc2fa18a784b7db6714c55d11c99de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.711014 4197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13202f85621849e486b6c76a7dea3195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.715998 4096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 101f669f72414b4b8251ae83a179e212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.717991 4097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb302e43385b402da2ae60a60aa7d056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.758723 4100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84cae2afafb44f7282bf39d784f44b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:31:38.839988 4254 heartbeater.cc:503] Master 127.3.187.254:40561 was elected leader, sending a full tablet report...
I20260807 13:31:38.911535 4280 tablet_bootstrap.cc:654] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:38.985004 4283 tablet_bootstrap.cc:492] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Bootstrap starting.
I20260807 13:31:38.990940 4280 tablet_bootstrap.cc:492] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7: No bootstrap required, opened a new log
I20260807 13:31:38.991683 4280 ts_tablet_manager.cc:1397] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent bootstrapping tablet: real 0.360s user 0.008s sys 0.029s
I20260807 13:31:38.995451 4281 tablet_bootstrap.cc:492] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b: Bootstrap starting.
I20260807 13:31:39.016192 4280 raft_consensus.cc:348] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.018292 4280 raft_consensus.cc:374] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.018874 4280 raft_consensus.cc:729] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.039830 4280 consensus_queue.cc:260] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.044636 4281 tablet_bootstrap.cc:654] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.045994 4283 tablet_bootstrap.cc:654] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.062224 4280 ts_tablet_manager.cc:1428] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent starting tablet: real 0.070s user 0.014s sys 0.021s
I20260807 13:31:39.064360 4280 tablet_bootstrap.cc:492] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7: Bootstrap starting.
I20260807 13:31:39.064853 4283 tablet_bootstrap.cc:492] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: No bootstrap required, opened a new log
I20260807 13:31:39.065435 4283 ts_tablet_manager.cc:1397] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent bootstrapping tablet: real 0.110s user 0.014s sys 0.017s
I20260807 13:31:39.070808 4283 raft_consensus.cc:348] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.071784 4283 raft_consensus.cc:374] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.072327 4283 raft_consensus.cc:729] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.073709 4281 tablet_bootstrap.cc:492] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b: No bootstrap required, opened a new log
I20260807 13:31:39.074501 4281 ts_tablet_manager.cc:1397] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b: Time spent bootstrapping tablet: real 0.098s user 0.017s sys 0.017s
I20260807 13:31:39.073907 4283 consensus_queue.cc:260] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.080104 4281 raft_consensus.cc:348] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.081086 4281 raft_consensus.cc:374] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.081432 4281 raft_consensus.cc:729] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.082482 4281 consensus_queue.cc:260] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.089614 4280 tablet_bootstrap.cc:654] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.096401 4283 ts_tablet_manager.cc:1428] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent starting tablet: real 0.030s user 0.007s sys 0.020s
W20260807 13:31:39.102255 4045 tablet.cc:2369] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:31:39.101118 4283 tablet_bootstrap.cc:492] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Bootstrap starting.
I20260807 13:31:39.123507 4283 tablet_bootstrap.cc:654] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Neither blocks nor log segments found. Creating new log.
W20260807 13:31:39.127066 4250 debug-util.cc:398] Leaking SignalData structure 0x7b080016c060 after lost signal to thread 3828
W20260807 13:31:39.128469 4250 debug-util.cc:398] Leaking SignalData structure 0x7b080016c740 after lost signal to thread 3911
I20260807 13:31:39.144126 4281 ts_tablet_manager.cc:1428] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b: Time spent starting tablet: real 0.069s user 0.022s sys 0.013s
I20260807 13:31:39.145481 4281 tablet_bootstrap.cc:492] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b: Bootstrap starting.
I20260807 13:31:39.155865 4280 tablet_bootstrap.cc:492] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7: No bootstrap required, opened a new log
I20260807 13:31:39.157058 4280 ts_tablet_manager.cc:1397] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent bootstrapping tablet: real 0.093s user 0.012s sys 0.041s
I20260807 13:31:39.163241 4280 raft_consensus.cc:348] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.164748 4280 raft_consensus.cc:374] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.165392 4280 raft_consensus.cc:729] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.166424 4281 tablet_bootstrap.cc:654] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.166947 4280 consensus_queue.cc:260] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.169843 4283 tablet_bootstrap.cc:492] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: No bootstrap required, opened a new log
I20260807 13:31:39.170770 4283 ts_tablet_manager.cc:1397] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent bootstrapping tablet: real 0.070s user 0.028s sys 0.022s
I20260807 13:31:39.174154 4280 ts_tablet_manager.cc:1428] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent starting tablet: real 0.016s user 0.004s sys 0.008s
I20260807 13:31:39.175511 4280 tablet_bootstrap.cc:492] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7: Bootstrap starting.
I20260807 13:31:39.182142 4283 raft_consensus.cc:348] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.183320 4283 raft_consensus.cc:374] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.184028 4283 raft_consensus.cc:729] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.185305 4283 consensus_queue.cc:260] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.188757 4283 ts_tablet_manager.cc:1428] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent starting tablet: real 0.017s user 0.005s sys 0.005s
I20260807 13:31:39.189898 4280 tablet_bootstrap.cc:654] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.190173 4283 tablet_bootstrap.cc:492] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Bootstrap starting.
I20260807 13:31:39.215742 4283 tablet_bootstrap.cc:654] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.222572 4280 tablet_bootstrap.cc:492] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7: No bootstrap required, opened a new log
I20260807 13:31:39.223248 4280 ts_tablet_manager.cc:1397] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.028s
I20260807 13:31:39.228765 4280 raft_consensus.cc:348] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.229869 4280 raft_consensus.cc:374] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.230393 4280 raft_consensus.cc:729] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.231638 4280 consensus_queue.cc:260] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.237038 4280 ts_tablet_manager.cc:1428] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260807 13:31:39.238603 4280 tablet_bootstrap.cc:492] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7: Bootstrap starting.
I20260807 13:31:39.243186 4281 tablet_bootstrap.cc:492] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b: No bootstrap required, opened a new log
I20260807 13:31:39.243934 4281 ts_tablet_manager.cc:1397] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b: Time spent bootstrapping tablet: real 0.099s user 0.009s sys 0.023s
I20260807 13:31:39.255581 4281 raft_consensus.cc:348] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.257018 4281 raft_consensus.cc:374] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.257634 4281 raft_consensus.cc:729] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.258867 4281 consensus_queue.cc:260] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.265034 4281 ts_tablet_manager.cc:1428] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b: Time spent starting tablet: real 0.020s user 0.009s sys 0.003s
I20260807 13:31:39.266631 4281 tablet_bootstrap.cc:492] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b: Bootstrap starting.
I20260807 13:31:39.267758 4283 tablet_bootstrap.cc:492] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: No bootstrap required, opened a new log
I20260807 13:31:39.268414 4283 ts_tablet_manager.cc:1397] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent bootstrapping tablet: real 0.079s user 0.020s sys 0.013s
I20260807 13:31:39.276108 4286 raft_consensus.cc:482] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:39.278906 4286 raft_consensus.cc:504] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.284381 4280 tablet_bootstrap.cc:654] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.286660 4286 leader_election.cc:288] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.286918 4292 raft_consensus.cc:482] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:39.285673 4281 tablet_bootstrap.cc:654] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.292312 4292 raft_consensus.cc:504] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.306612 4292 leader_election.cc:288] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:39.310993 4283 raft_consensus.cc:348] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.317595 4283 raft_consensus.cc:374] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.318224 4283 raft_consensus.cc:729] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.321993 4283 consensus_queue.cc:260] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
W20260807 13:31:39.326242 3931 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:31:39.344566 4283 ts_tablet_manager.cc:1428] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent starting tablet: real 0.076s user 0.015s sys 0.004s
I20260807 13:31:39.352559 4283 tablet_bootstrap.cc:492] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Bootstrap starting.
I20260807 13:31:39.389364 4286 raft_consensus.cc:482] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:39.389600 4283 tablet_bootstrap.cc:654] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.390237 4286 raft_consensus.cc:504] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.400251 4294 raft_consensus.cc:482] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:39.401407 4294 raft_consensus.cc:504] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.409703 4286 leader_election.cc:288] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.416121 4280 tablet_bootstrap.cc:492] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7: No bootstrap required, opened a new log
I20260807 13:31:39.419353 4280 ts_tablet_manager.cc:1397] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent bootstrapping tablet: real 0.181s user 0.027s sys 0.036s
I20260807 13:31:39.409363 4294 leader_election.cc:288] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.455672 4292 raft_consensus.cc:482] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:39.460840 4286 raft_consensus.cc:482] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:39.461349 4292 raft_consensus.cc:504] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.461841 4286 raft_consensus.cc:504] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.475919 4286 leader_election.cc:288] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.496731 4294 raft_consensus.cc:482] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:39.497648 4294 raft_consensus.cc:504] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.501434 4294 leader_election.cc:288] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.548548 4280 raft_consensus.cc:348] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.560689 4320 raft_consensus.cc:482] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:39.554257 4292 leader_election.cc:288] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:39.566061 4281 tablet_bootstrap.cc:492] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b: No bootstrap required, opened a new log
I20260807 13:31:39.566771 4281 ts_tablet_manager.cc:1397] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b: Time spent bootstrapping tablet: real 0.301s user 0.013s sys 0.026s
I20260807 13:31:39.562891 4280 raft_consensus.cc:374] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.570945 4280 raft_consensus.cc:729] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.572089 4280 consensus_queue.cc:260] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.577750 4320 raft_consensus.cc:504] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.584384 4280 ts_tablet_manager.cc:1428] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent starting tablet: real 0.162s user 0.003s sys 0.015s
I20260807 13:31:39.590797 4280 tablet_bootstrap.cc:492] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7: Bootstrap starting.
I20260807 13:31:39.588814 4320 leader_election.cc:288] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:39.592082 4283 tablet_bootstrap.cc:492] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: No bootstrap required, opened a new log
I20260807 13:31:39.595407 4281 raft_consensus.cc:348] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.596942 4283 ts_tablet_manager.cc:1397] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent bootstrapping tablet: real 0.246s user 0.010s sys 0.030s
I20260807 13:31:39.598752 4281 raft_consensus.cc:374] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.601850 4281 raft_consensus.cc:729] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.602237 4225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:39.605587 4225 raft_consensus.cc:2454] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 0.
I20260807 13:31:39.598547 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:39.617931 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:39.627100 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:39.615579 4281 consensus_queue.cc:260] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.631402 4008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:39.638540 4006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:39.635812 4008 raft_consensus.cc:2454] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 0.
I20260807 13:31:39.632143 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:39.649727 4115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:39.651563 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:39.652057 4115 raft_consensus.cc:2454] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 0.
I20260807 13:31:39.649176 3956 leader_election.cc:302] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
W20260807 13:31:39.656157 3957 leader_election.cc:341] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.662420 4281 ts_tablet_manager.cc:1428] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b: Time spent starting tablet: real 0.095s user 0.007s sys 0.006s
I20260807 13:31:39.663661 4281 tablet_bootstrap.cc:492] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b: Bootstrap starting.
W20260807 13:31:39.664324 3956 leader_election.cc:341] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.664640 4286 raft_consensus.cc:2781] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:39.665216 4286 raft_consensus.cc:482] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:39.665759 4286 raft_consensus.cc:3037] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:39.655484 4113 raft_consensus.cc:2454] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 0.
I20260807 13:31:39.651448 4283 raft_consensus.cc:348] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.667836 4283 raft_consensus.cc:374] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.670177 4283 raft_consensus.cc:729] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.671348 4283 consensus_queue.cc:260] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
W20260807 13:31:39.679594 4167 leader_election.cc:341] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.684465 4283 ts_tablet_manager.cc:1428] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent starting tablet: real 0.085s user 0.012s sys 0.003s
I20260807 13:31:39.686062 4283 tablet_bootstrap.cc:492] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Bootstrap starting.
I20260807 13:31:39.676640 3957 leader_election.cc:302] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters: cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:39.695175 4226 raft_consensus.cc:2454] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 0.
I20260807 13:31:39.705420 4325 raft_consensus.cc:2781] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:39.705909 4325 raft_consensus.cc:482] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:39.706269 4325 raft_consensus.cc:3037] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:39.714591 4167 leader_election.cc:302] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:39.719237 4286 raft_consensus.cc:504] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.721123 4320 raft_consensus.cc:2781] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:39.721684 4320 raft_consensus.cc:482] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:39.722139 4320 raft_consensus.cc:3037] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:39.724072 4286 leader_election.cc:288] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Requested vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.729342 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:39.729988 4113 raft_consensus.cc:3037] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:31:39.727310 4167 leader_election.cc:341] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.731129 4280 tablet_bootstrap.cc:654] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.738499 3956 leader_election.cc:302] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: ca569eb2b573447f81328411193cfa3b
I20260807 13:31:39.740078 4320 raft_consensus.cc:504] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.742492 4286 raft_consensus.cc:2781] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:39.743046 4286 raft_consensus.cc:482] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:39.743667 4286 raft_consensus.cc:3037] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:39.744339 4283 tablet_bootstrap.cc:654] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.746541 4320 leader_election.cc:288] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:39.747921 4281 tablet_bootstrap.cc:654] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.749308 4113 raft_consensus.cc:2454] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 1.
I20260807 13:31:39.751377 3957 leader_election.cc:302] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:39.765585 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:39.766532 4226 raft_consensus.cc:2379] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43e93bfb0c034b22803db3ee19e7c9f7 in current term 1: Already voted for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in this term.
I20260807 13:31:39.773804 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:39.775803 4010 raft_consensus.cc:2379] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in current term 1: Already voted for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in this term.
I20260807 13:31:39.784658 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:39.787020 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:39.788077 4223 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 0.
W20260807 13:31:39.791728 4060 leader_election.cc:341] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.789680 4326 raft_consensus.cc:2781] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:39.800356 4060 leader_election.cc:302] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:39.802965 4294 raft_consensus.cc:2781] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:39.803467 4294 raft_consensus.cc:482] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:39.804141 4294 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:39.817466 4008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:39.819478 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
W20260807 13:31:39.823168 4061 leader_election.cc:341] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:31:39.829070 4167 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:38213, user_credentials={real_user=slave}} blocked reactor thread for 49870.7us
I20260807 13:31:39.830237 4326 raft_consensus.cc:686] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Leader. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:39.834192 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:39.840623 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:39.841946 4113 raft_consensus.cc:2379] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in current term 1: Already voted for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in this term.
I20260807 13:31:39.843906 4286 raft_consensus.cc:504] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.845970 4283 tablet_bootstrap.cc:492] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: No bootstrap required, opened a new log
I20260807 13:31:39.846705 4283 ts_tablet_manager.cc:1397] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent bootstrapping tablet: real 0.161s user 0.013s sys 0.014s
I20260807 13:31:39.848869 4286 leader_election.cc:288] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Requested vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.833930 4326 consensus_queue.cc:237] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.848773 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
W20260807 13:31:39.849862 4167 leader_election.cc:341] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.850730 4115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:39.851748 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:39.858763 4115 raft_consensus.cc:2379] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in current term 1: Already voted for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in this term.
W20260807 13:31:39.860460 3957 leader_election.cc:341] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.853451 4294 raft_consensus.cc:504] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.860937 4325 raft_consensus.cc:504] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.857136 4167 leader_election.cc:302] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b
I20260807 13:31:39.872130 4283 raft_consensus.cc:348] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.876430 4010 raft_consensus.cc:2379] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca569eb2b573447f81328411193cfa3b in current term 1: Already voted for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in this term.
I20260807 13:31:39.882171 4283 raft_consensus.cc:374] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.882522 4113 raft_consensus.cc:2379] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in current term 1: Already voted for candidate ca569eb2b573447f81328411193cfa3b in this term.
I20260807 13:31:39.882719 4283 raft_consensus.cc:729] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.884037 4283 consensus_queue.cc:260] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.886448 4281 tablet_bootstrap.cc:492] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b: No bootstrap required, opened a new log
I20260807 13:31:39.889859 4061 leader_election.cc:302] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca569eb2b573447f81328411193cfa3b; no voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:39.890507 4292 raft_consensus.cc:2726] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:31:39.895926 4280 tablet_bootstrap.cc:492] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7: No bootstrap required, opened a new log
I20260807 13:31:39.896445 4280 ts_tablet_manager.cc:1397] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent bootstrapping tablet: real 0.306s user 0.008s sys 0.023s
I20260807 13:31:39.898975 4283 ts_tablet_manager.cc:1428] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent starting tablet: real 0.052s user 0.004s sys 0.010s
I20260807 13:31:39.900132 4283 tablet_bootstrap.cc:492] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Bootstrap starting.
W20260807 13:31:39.902304 4167 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:36523, user_credentials={real_user=slave}} blocked reactor thread for 52772.2us
I20260807 13:31:39.903741 4326 raft_consensus.cc:482] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:39.905580 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:39.905732 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:39.888981 4325 leader_election.cc:288] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Requested vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.903167 4294 leader_election.cc:288] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.904489 4326 raft_consensus.cc:504] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.907145 4223 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:39.907476 4281 ts_tablet_manager.cc:1397] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b: Time spent bootstrapping tablet: real 0.244s user 0.013s sys 0.028s
I20260807 13:31:39.906989 4113 raft_consensus.cc:3037] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:39.889595 3869 catalog_manager.cc:5495] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193). New cstate: current_term: 1 leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:39.920552 4326 leader_election.cc:288] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:39.921578 4115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13202f85621849e486b6c76a7dea3195" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:39.907328 4280 raft_consensus.cc:348] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.924551 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:39.925635 4280 raft_consensus.cc:374] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.926137 4280 raft_consensus.cc:729] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Initialized, Role: FOLLOWER
I20260807 13:31:39.926705 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:39.927923 4226 raft_consensus.cc:3037] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:39.927713 4280 consensus_queue.cc:260] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
W20260807 13:31:39.924288 3957 leader_election.cc:341] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:31:39.931366 4061 leader_election.cc:341] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.938771 4167 leader_election.cc:302] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b
I20260807 13:31:39.938536 4222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13202f85621849e486b6c76a7dea3195" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:39.936033 4225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:39.940910 4280 ts_tablet_manager.cc:1428] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent starting tablet: real 0.044s user 0.010s sys 0.005s
I20260807 13:31:39.942313 4292 raft_consensus.cc:2726] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:31:39.944470 4281 raft_consensus.cc:348] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.944837 4167 leader_election.cc:302] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b
I20260807 13:31:39.945528 4281 raft_consensus.cc:374] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:39.946166 4113 raft_consensus.cc:2454] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 1.
I20260807 13:31:39.947220 4294 raft_consensus.cc:2726] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:31:39.947536 4280 tablet_bootstrap.cc:492] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7: Bootstrap starting.
I20260807 13:31:39.946008 4281 raft_consensus.cc:729] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Initialized, Role: FOLLOWER
W20260807 13:31:39.953166 3956 leader_election.cc:341] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.953994 3956 leader_election.cc:302] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7; no voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:39.956009 3957 leader_election.cc:302] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:39.956771 4326 raft_consensus.cc:2726] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:31:39.957080 4283 tablet_bootstrap.cc:654] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Neither blocks nor log segments found. Creating new log.
W20260807 13:31:39.957310 3956 leader_election.cc:341] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:39.957572 4325 raft_consensus.cc:2781] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:39.958436 4325 raft_consensus.cc:686] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Leader. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:39.958051 4281 consensus_queue.cc:260] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.959964 4325 consensus_queue.cc:237] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.963075 4281 ts_tablet_manager.cc:1428] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b: Time spent starting tablet: real 0.052s user 0.014s sys 0.002s
I20260807 13:31:39.970075 4226 raft_consensus.cc:2454] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 1.
I20260807 13:31:39.972020 4223 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 1.
I20260807 13:31:39.972926 4281 tablet_bootstrap.cc:492] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b: Bootstrap starting.
I20260807 13:31:39.972856 4292 raft_consensus.cc:2726] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:31:39.977941 4060 leader_election.cc:302] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: 43e93bfb0c034b22803db3ee19e7c9f7
I20260807 13:31:39.980137 4294 raft_consensus.cc:2781] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:39.980932 4294 raft_consensus.cc:686] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 1 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:39.982422 4280 tablet_bootstrap.cc:654] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:39.982467 4294 consensus_queue.cc:237] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:39.984807 3956 leader_election.cc:302] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: ca569eb2b573447f81328411193cfa3b
I20260807 13:31:39.993979 4286 raft_consensus.cc:2781] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:39.994711 4286 raft_consensus.cc:686] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Leader. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:39.995954 4286 consensus_queue.cc:237] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.063526 4281 tablet_bootstrap.cc:654] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.085495 3867 catalog_manager.cc:5495] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 0 to 1, leader changed from <none> to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 1 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:40.096402 4280 tablet_bootstrap.cc:492] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7: No bootstrap required, opened a new log
I20260807 13:31:40.096882 4280 ts_tablet_manager.cc:1397] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent bootstrapping tablet: real 0.150s user 0.015s sys 0.015s
I20260807 13:31:40.102773 4292 raft_consensus.cc:482] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:40.103133 4283 tablet_bootstrap.cc:492] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: No bootstrap required, opened a new log
I20260807 13:31:40.103399 4292 raft_consensus.cc:504] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.103955 4283 ts_tablet_manager.cc:1397] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent bootstrapping tablet: real 0.204s user 0.007s sys 0.029s
I20260807 13:31:40.108496 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:40.108906 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
W20260807 13:31:40.110235 4167 leader_election.cc:341] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:40.110821 4292 leader_election.cc:288] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
W20260807 13:31:40.111122 4167 leader_election.cc:341] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:40.111660 4167 leader_election.cc:302] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b
I20260807 13:31:40.109552 4283 raft_consensus.cc:348] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.112599 4292 raft_consensus.cc:2726] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:31:40.113499 4280 raft_consensus.cc:348] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.115002 4283 raft_consensus.cc:374] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.118732 4283 raft_consensus.cc:729] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.118403 4280 raft_consensus.cc:374] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.126190 4280 raft_consensus.cc:729] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.133592 4280 consensus_queue.cc:260] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.135774 4281 tablet_bootstrap.cc:492] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b: No bootstrap required, opened a new log
I20260807 13:31:40.136472 4281 ts_tablet_manager.cc:1397] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b: Time spent bootstrapping tablet: real 0.164s user 0.010s sys 0.020s
I20260807 13:31:40.135068 4283 consensus_queue.cc:260] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.149673 4283 ts_tablet_manager.cc:1428] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent starting tablet: real 0.045s user 0.013s sys 0.002s
I20260807 13:31:40.159373 4283 tablet_bootstrap.cc:492] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Bootstrap starting.
I20260807 13:31:40.151744 4281 raft_consensus.cc:348] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.165789 4281 raft_consensus.cc:374] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.166345 4281 raft_consensus.cc:729] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.167615 4281 consensus_queue.cc:260] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.146195 3869 catalog_manager.cc:5495] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193). New cstate: current_term: 1 leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:40.186185 4281 ts_tablet_manager.cc:1428] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b: Time spent starting tablet: real 0.042s user 0.011s sys 0.004s
I20260807 13:31:40.188378 4281 tablet_bootstrap.cc:492] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b: Bootstrap starting.
I20260807 13:31:40.188721 4280 ts_tablet_manager.cc:1428] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent starting tablet: real 0.092s user 0.010s sys 0.002s
I20260807 13:31:40.190466 4280 tablet_bootstrap.cc:492] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7: Bootstrap starting.
I20260807 13:31:40.190269 3869 catalog_manager.cc:5495] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193). New cstate: current_term: 1 leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:40.203819 4283 tablet_bootstrap.cc:654] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.214352 4325 raft_consensus.cc:482] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:40.215235 4325 raft_consensus.cc:504] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.218305 4281 tablet_bootstrap.cc:654] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.219267 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:40.220407 4325 leader_election.cc:288] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:40.220521 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
W20260807 13:31:40.220780 3957 leader_election.cc:341] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:31:40.227205 3956 leader_election.cc:341] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:40.229189 3956 leader_election.cc:302] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7; no voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:40.231153 4325 raft_consensus.cc:2726] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:31:40.243896 4325 raft_consensus.cc:482] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:40.244324 4325 raft_consensus.cc:504] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.245945 4292 raft_consensus.cc:482] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:40.246738 4325 leader_election.cc:288] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:40.246659 4292 raft_consensus.cc:504] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.247785 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:40.248504 4292 leader_election.cc:288] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:40.248238 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:40.249228 4226 raft_consensus.cc:2454] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 0.
W20260807 13:31:40.249531 3957 leader_election.cc:341] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:40.249814 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13202f85621849e486b6c76a7dea3195" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:40.250478 4010 raft_consensus.cc:2454] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 0.
I20260807 13:31:40.251744 4167 leader_election.cc:302] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:40.251969 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13202f85621849e486b6c76a7dea3195" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:40.252825 4292 raft_consensus.cc:2781] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:40.279989 4292 raft_consensus.cc:482] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:40.280318 4292 raft_consensus.cc:3037] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.281781 4281 tablet_bootstrap.cc:492] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b: No bootstrap required, opened a new log
I20260807 13:31:40.286427 4281 ts_tablet_manager.cc:1397] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b: Time spent bootstrapping tablet: real 0.099s user 0.014s sys 0.022s
I20260807 13:31:40.254254 3956 leader_election.cc:302] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: ca569eb2b573447f81328411193cfa3b
I20260807 13:31:40.287546 4325 raft_consensus.cc:2781] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:40.288201 4325 raft_consensus.cc:482] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:40.288756 4325 raft_consensus.cc:3037] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.289353 4280 tablet_bootstrap.cc:654] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.252990 4113 raft_consensus.cc:2454] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 0.
I20260807 13:31:40.294745 4281 raft_consensus.cc:348] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.295950 4281 raft_consensus.cc:374] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.302222 4281 raft_consensus.cc:729] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.303583 4281 consensus_queue.cc:260] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.306970 4283 tablet_bootstrap.cc:492] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: No bootstrap required, opened a new log
I20260807 13:31:40.307729 4283 ts_tablet_manager.cc:1397] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent bootstrapping tablet: real 0.149s user 0.008s sys 0.021s
I20260807 13:31:40.314585 4325 raft_consensus.cc:504] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.319981 4325 leader_election.cc:288] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Requested vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:40.322017 4281 ts_tablet_manager.cc:1428] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b: Time spent starting tablet: real 0.035s user 0.003s sys 0.008s
I20260807 13:31:40.321879 4283 raft_consensus.cc:348] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.323009 4280 tablet_bootstrap.cc:492] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7: No bootstrap required, opened a new log
I20260807 13:31:40.322768 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:40.323753 4113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:40.328114 4281 tablet_bootstrap.cc:492] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b: Bootstrap starting.
I20260807 13:31:40.326910 4226 raft_consensus.cc:3037] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.327970 4113 raft_consensus.cc:3037] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.327301 4283 raft_consensus.cc:374] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.337162 4280 ts_tablet_manager.cc:1397] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent bootstrapping tablet: real 0.147s user 0.007s sys 0.033s
I20260807 13:31:40.337458 4283 raft_consensus.cc:729] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.325783 4292 raft_consensus.cc:504] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.338752 4283 consensus_queue.cc:260] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.344600 4325 consensus_queue.cc:1035] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:31:40.345369 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13202f85621849e486b6c76a7dea3195" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:40.347091 4115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13202f85621849e486b6c76a7dea3195" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:40.347999 4115 raft_consensus.cc:3037] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.348944 4113 raft_consensus.cc:2454] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 1.
I20260807 13:31:40.345310 4292 leader_election.cc:288] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:40.349640 4010 raft_consensus.cc:3037] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.356676 4283 ts_tablet_manager.cc:1428] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent starting tablet: real 0.043s user 0.008s sys 0.004s
I20260807 13:31:40.360003 3957 leader_election.cc:302] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:40.377314 4325 raft_consensus.cc:2781] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:40.377673 4283 tablet_bootstrap.cc:492] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Bootstrap starting.
I20260807 13:31:40.378237 4325 raft_consensus.cc:686] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Leader. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
W20260807 13:31:40.379573 3931 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:31:40.383131 4280 raft_consensus.cc:348] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.384541 4280 raft_consensus.cc:374] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.379850 4325 consensus_queue.cc:237] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.391050 4286 consensus_queue.cc:1035] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:31:40.349532 4226 raft_consensus.cc:2454] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 1.
I20260807 13:31:40.396417 4010 raft_consensus.cc:2454] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 1.
I20260807 13:31:40.398684 4167 leader_election.cc:302] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:40.386673 4280 raft_consensus.cc:729] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.400559 4292 raft_consensus.cc:2781] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:40.400229 4280 consensus_queue.cc:260] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.401520 4292 raft_consensus.cc:686] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 LEADER]: Becoming Leader. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Running, Role: LEADER
I20260807 13:31:40.403345 4292 consensus_queue.cc:237] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.415283 4294 raft_consensus.cc:482] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:40.416000 4294 raft_consensus.cc:504] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.394626 4115 raft_consensus.cc:2454] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 1.
I20260807 13:31:40.424656 4294 leader_election.cc:288] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:40.425649 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a65b1f7710a4094a15b7a1239ee20df" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
W20260807 13:31:40.432964 4060 leader_election.cc:341] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:40.425648 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a65b1f7710a4094a15b7a1239ee20df" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:40.438879 3869 catalog_manager.cc:5495] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193). New cstate: current_term: 1 leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:40.438902 4010 raft_consensus.cc:2454] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 0.
I20260807 13:31:40.448184 4061 leader_election.cc:302] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters: cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:40.449963 4294 raft_consensus.cc:2781] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:40.450536 4294 raft_consensus.cc:482] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:40.451149 4294 raft_consensus.cc:3037] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.458731 4280 ts_tablet_manager.cc:1428] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent starting tablet: real 0.121s user 0.007s sys 0.007s
W20260807 13:31:40.463928 3957 consensus_peers.cc:487] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 -> Peer ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523): Couldn't send request to peer ca569eb2b573447f81328411193cfa3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:31:40.464586 4280 tablet_bootstrap.cc:492] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7: Bootstrap starting.
I20260807 13:31:40.464139 4331 consensus_queue.cc:1035] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:31:40.471242 3867 catalog_manager.cc:5495] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda reported cstate change: term changed from 0 to 1, leader changed from <none> to cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195). New cstate: current_term: 1 leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260807 13:31:40.504125 4325 consensus_queue.cc:1035] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:31:40.505024 4281 tablet_bootstrap.cc:654] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.509536 4283 tablet_bootstrap.cc:654] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.483942 4294 raft_consensus.cc:504] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.542335 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a65b1f7710a4094a15b7a1239ee20df" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:40.543247 4010 raft_consensus.cc:3037] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.553915 4294 leader_election.cc:288] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:40.552845 4280 tablet_bootstrap.cc:654] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.556401 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a65b1f7710a4094a15b7a1239ee20df" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
W20260807 13:31:40.561262 4060 leader_election.cc:341] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:31:40.580159 4010 raft_consensus.cc:2454] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 1.
I20260807 13:31:40.590209 4223 raft_consensus.cc:3037] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.607326 4061 leader_election.cc:302] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters: cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:40.626904 4338 raft_consensus.cc:2781] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:40.627866 4338 raft_consensus.cc:686] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 1 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:40.636030 4281 tablet_bootstrap.cc:492] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b: No bootstrap required, opened a new log
I20260807 13:31:40.637351 4281 ts_tablet_manager.cc:1397] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b: Time spent bootstrapping tablet: real 0.309s user 0.013s sys 0.044s
I20260807 13:31:40.637600 4294 consensus_queue.cc:1035] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:31:40.641031 4061 consensus_peers.cc:487] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b -> Peer 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213): Couldn't send request to peer 43e93bfb0c034b22803db3ee19e7c9f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:31:40.629379 4338 consensus_queue.cc:237] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.644447 4286 consensus_queue.cc:1035] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:31:40.663558 4283 tablet_bootstrap.cc:492] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda: No bootstrap required, opened a new log
I20260807 13:31:40.667423 4283 ts_tablet_manager.cc:1397] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent bootstrapping tablet: real 0.294s user 0.012s sys 0.032s
I20260807 13:31:40.670307 4280 tablet_bootstrap.cc:492] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7: No bootstrap required, opened a new log
I20260807 13:31:40.672467 4280 ts_tablet_manager.cc:1397] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent bootstrapping tablet: real 0.208s user 0.017s sys 0.026s
I20260807 13:31:40.681077 4280 raft_consensus.cc:348] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.686970 4280 raft_consensus.cc:374] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.687453 4280 raft_consensus.cc:729] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.685813 4283 raft_consensus.cc:348] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.688321 4283 raft_consensus.cc:374] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.688601 4283 raft_consensus.cc:729] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.688480 4280 consensus_queue.cc:260] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.689335 4283 consensus_queue.cc:260] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.695573 4280 ts_tablet_manager.cc:1428] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent starting tablet: real 0.022s user 0.001s sys 0.011s
I20260807 13:31:40.696575 4280 tablet_bootstrap.cc:492] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7: Bootstrap starting.
I20260807 13:31:40.687348 4281 raft_consensus.cc:348] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.702340 4281 raft_consensus.cc:374] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.702843 4281 raft_consensus.cc:729] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.706952 3869 catalog_manager.cc:5495] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 0 to 1, leader changed from <none> to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 1 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:40.710553 4283 ts_tablet_manager.cc:1428] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent starting tablet: real 0.041s user 0.007s sys 0.007s
I20260807 13:31:40.711463 4283 tablet_bootstrap.cc:492] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Bootstrap starting.
I20260807 13:31:40.703962 4281 consensus_queue.cc:260] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.716008 4281 ts_tablet_manager.cc:1428] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b: Time spent starting tablet: real 0.069s user 0.009s sys 0.003s
I20260807 13:31:40.721282 4281 tablet_bootstrap.cc:492] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b: Bootstrap starting.
I20260807 13:31:40.719430 4280 tablet_bootstrap.cc:654] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.747785 4283 tablet_bootstrap.cc:654] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.754875 4281 tablet_bootstrap.cc:654] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.764618 4280 tablet_bootstrap.cc:492] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7: No bootstrap required, opened a new log
I20260807 13:31:40.765267 4280 ts_tablet_manager.cc:1397] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent bootstrapping tablet: real 0.069s user 0.010s sys 0.020s
I20260807 13:31:40.769369 4280 raft_consensus.cc:348] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.770650 4280 raft_consensus.cc:374] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.771133 4280 raft_consensus.cc:729] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.771837 4280 consensus_queue.cc:260] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.778342 4280 ts_tablet_manager.cc:1428] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7: Time spent starting tablet: real 0.013s user 0.007s sys 0.002s
I20260807 13:31:40.780638 4283 tablet_bootstrap.cc:492] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda: No bootstrap required, opened a new log
I20260807 13:31:40.781219 4283 ts_tablet_manager.cc:1397] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent bootstrapping tablet: real 0.070s user 0.013s sys 0.012s
I20260807 13:31:40.796798 4283 raft_consensus.cc:348] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.797499 4283 raft_consensus.cc:374] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.797770 4283 raft_consensus.cc:729] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.798547 4283 consensus_queue.cc:260] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.801031 4283 ts_tablet_manager.cc:1428] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda: Time spent starting tablet: real 0.019s user 0.003s sys 0.003s
I20260807 13:31:40.804330 4281 tablet_bootstrap.cc:492] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b: No bootstrap required, opened a new log
I20260807 13:31:40.805163 4281 ts_tablet_manager.cc:1397] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.028s
I20260807 13:31:40.811069 4281 raft_consensus.cc:348] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.812551 4281 raft_consensus.cc:374] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.812963 4281 raft_consensus.cc:729] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.813817 4281 consensus_queue.cc:260] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.821813 4281 ts_tablet_manager.cc:1428] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b: Time spent starting tablet: real 0.016s user 0.003s sys 0.008s
I20260807 13:31:40.822935 4281 tablet_bootstrap.cc:492] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b: Bootstrap starting.
I20260807 13:31:40.825127 4292 raft_consensus.cc:482] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:40.825897 4292 raft_consensus.cc:504] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.831322 4292 leader_election.cc:288] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:40.832849 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:40.837129 4010 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 0.
I20260807 13:31:40.835477 4115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:40.839376 4115 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 0.
I20260807 13:31:40.841979 4167 leader_election.cc:302] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:40.844241 4292 raft_consensus.cc:2781] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:40.844846 4292 raft_consensus.cc:482] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:40.845467 4292 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.847271 4281 tablet_bootstrap.cc:654] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b: Neither blocks nor log segments found. Creating new log.
I20260807 13:31:40.866513 4320 consensus_queue.cc:1035] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260807 13:31:40.876381 4292 raft_consensus.cc:504] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.878796 4286 consensus_queue.cc:1035] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:31:40.881989 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:40.882978 4010 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.887459 4281 tablet_bootstrap.cc:492] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b: No bootstrap required, opened a new log
I20260807 13:31:40.887965 4281 ts_tablet_manager.cc:1397] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b: Time spent bootstrapping tablet: real 0.065s user 0.031s sys 0.009s
I20260807 13:31:40.891453 4281 raft_consensus.cc:348] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.892253 4281 raft_consensus.cc:374] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:31:40.892477 4281 raft_consensus.cc:729] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Initialized, Role: FOLLOWER
I20260807 13:31:40.894045 4010 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 1.
I20260807 13:31:40.895601 4281 consensus_queue.cc:260] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.895826 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:40.896656 4116 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:40.899569 4281 ts_tablet_manager.cc:1428] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b: Time spent starting tablet: real 0.011s user 0.004s sys 0.001s
I20260807 13:31:40.899788 4167 leader_election.cc:302] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:40.902357 4320 raft_consensus.cc:2781] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:40.895431 4292 leader_election.cc:288] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:40.910554 4331 raft_consensus.cc:482] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:40.911350 4331 raft_consensus.cc:504] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.913757 4116 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 1.
I20260807 13:31:40.915670 4331 leader_election.cc:288] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:40.931372 4331 consensus_queue.cc:1035] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:31:40.934759 4115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:40.945214 4375 raft_consensus.cc:482] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:40.946002 4375 raft_consensus.cc:504] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:40.956583 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:40.967250 4375 leader_election.cc:288] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:40.969448 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:40.973080 4060 leader_election.cc:302] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca569eb2b573447f81328411193cfa3b; no voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:40.974377 4375 raft_consensus.cc:2726] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:31:40.977319 4116 raft_consensus.cc:3037] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:31:40.970988 4167 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:36523, user_credentials={real_user=slave}} blocked reactor thread for 68400.5us
I20260807 13:31:40.979861 4320 raft_consensus.cc:686] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 LEADER]: Becoming Leader. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Running, Role: LEADER
I20260807 13:31:40.993287 4320 consensus_queue.cc:237] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:41.000691 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:41.024183 3956 leader_election.cc:302] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7; no voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:41.026360 4286 raft_consensus.cc:2726] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:31:41.033594 4010 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:41.039014 4390 consensus_queue.cc:1035] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:31:41.099545 4390 raft_consensus.cc:482] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:41.100585 4390 raft_consensus.cc:504] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:41.106952 4390 leader_election.cc:288] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:41.109254 4006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a65b1f7710a4094a15b7a1239ee20df" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:41.110809 4006 raft_consensus.cc:2379] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in current term 1: Already voted for candidate ca569eb2b573447f81328411193cfa3b in this term.
I20260807 13:31:41.109280 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a65b1f7710a4094a15b7a1239ee20df" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:41.121325 4167 leader_election.cc:302] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b
I20260807 13:31:41.122364 4325 raft_consensus.cc:482] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:41.124379 4390 raft_consensus.cc:3037] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:41.123687 4325 raft_consensus.cc:504] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:41.139847 4375 consensus_queue.cc:1035] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:31:41.140172 4338 raft_consensus.cc:482] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:31:41.140895 4338 raft_consensus.cc:504] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:41.149050 4006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" is_pre_election: true
I20260807 13:31:41.150000 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:41.150341 4006 raft_consensus.cc:2454] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 0.
I20260807 13:31:41.151176 4223 raft_consensus.cc:2454] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 0.
I20260807 13:31:41.150285 4338 leader_election.cc:288] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:41.153542 4325 leader_election.cc:288] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:41.153708 4061 leader_election.cc:302] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:41.154897 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b" is_pre_election: true
I20260807 13:31:41.156005 4116 raft_consensus.cc:2454] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 0.
I20260807 13:31:41.157991 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" is_pre_election: true
I20260807 13:31:41.158354 3957 leader_election.cc:302] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:41.157083 4338 raft_consensus.cc:2781] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:41.158953 4223 raft_consensus.cc:2454] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 0.
I20260807 13:31:41.159641 4325 raft_consensus.cc:2781] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:31:41.163990 4325 raft_consensus.cc:482] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:41.164517 4325 raft_consensus.cc:3037] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:41.129630 3866 catalog_manager.cc:5495] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda reported cstate change: term changed from 0 to 1, leader changed from <none> to cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195). New cstate: current_term: 1 leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260807 13:31:41.160174 4338 raft_consensus.cc:482] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:31:41.168069 4390 raft_consensus.cc:2726] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:31:41.172325 4338 raft_consensus.cc:3037] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:41.187439 4375 consensus_queue.cc:1035] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:31:41.186761 4325 raft_consensus.cc:504] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:41.197822 4325 leader_election.cc:288] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Requested vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:41.198329 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:41.199384 4226 raft_consensus.cc:3037] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:31:41.202076 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:41.204344 4338 raft_consensus.cc:504] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:41.206483 4116 raft_consensus.cc:2379] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 43e93bfb0c034b22803db3ee19e7c9f7 in current term 1: Already voted for candidate ca569eb2b573447f81328411193cfa3b in this term.
I20260807 13:31:41.218508 4226 raft_consensus.cc:2454] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 1.
I20260807 13:31:41.220935 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:41.221819 3956 leader_election.cc:302] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters: ca569eb2b573447f81328411193cfa3b
I20260807 13:31:41.222337 4010 raft_consensus.cc:2379] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca569eb2b573447f81328411193cfa3b in current term 1: Already voted for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in this term.
I20260807 13:31:41.227403 4325 raft_consensus.cc:2781] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:31:41.229061 4338 leader_election.cc:288] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:41.228246 4325 raft_consensus.cc:686] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Leader. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:41.236168 4325 consensus_queue.cc:237] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:41.241024 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:41.244849 4226 raft_consensus.cc:2379] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca569eb2b573447f81328411193cfa3b in current term 1: Already voted for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in this term.
I20260807 13:31:41.246389 4060 leader_election.cc:302] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca569eb2b573447f81328411193cfa3b; no voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:41.251505 4338 raft_consensus.cc:2726] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:31:41.271238 3869 catalog_manager.cc:5495] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193). New cstate: current_term: 1 leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:41.521404 4390 consensus_queue.cc:1035] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:31:41.535224 4410 consensus_queue.cc:1035] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:31:41.681442 4325 consensus_queue.cc:1035] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:31:41.691891 4326 consensus_queue.cc:1035] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:31:41.820154 4116 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
mode: GRACEFUL
new_leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
from {username='slave'} at 127.0.0.1:56918
I20260807 13:31:41.820945 4116 raft_consensus.cc:595] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 1 LEADER]: Received request to transfer leadership to TS 43e93bfb0c034b22803db3ee19e7c9f7
I20260807 13:31:41.843659 4010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
mode: GRACEFUL
new_leader_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:43318
I20260807 13:31:41.844193 4010 raft_consensus.cc:595] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Received request to transfer leadership to TS ca569eb2b573447f81328411193cfa3b
I20260807 13:31:41.848749 4010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "101f669f72414b4b8251ae83a179e212"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
mode: GRACEFUL
new_leader_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:43318
I20260807 13:31:41.849228 4010 raft_consensus.cc:595] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Received request to transfer leadership to TS ca569eb2b573447f81328411193cfa3b
I20260807 13:31:41.864064 4223 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de"
dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
mode: GRACEFUL
new_leader_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:53780
I20260807 13:31:41.864568 4223 raft_consensus.cc:595] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 LEADER]: Received request to transfer leadership to TS ca569eb2b573447f81328411193cfa3b
I20260807 13:31:41.979285 4286 raft_consensus.cc:979] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7: : Instructing follower ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:41.979882 4326 raft_consensus.cc:1067] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Signalling peer ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:41.981647 4116 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:56888
I20260807 13:31:41.982420 4116 raft_consensus.cc:482] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:41.982872 4116 raft_consensus.cc:3037] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:41.990339 4116 raft_consensus.cc:504] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:41.992633 4116 leader_election.cc:288] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:41.993862 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:41.994217 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:41.994511 4223 raft_consensus.cc:3037] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:41.994776 4010 raft_consensus.cc:3032] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:31:41.995088 4010 raft_consensus.cc:729] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:41.995847 4010 consensus_queue.cc:260] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:41.997182 4010 raft_consensus.cc:3037] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.000578 4223 raft_consensus.cc:2454] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:42.001711 4060 leader_election.cc:302] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:42.002552 4404 raft_consensus.cc:2781] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:31:42.003074 4404 raft_consensus.cc:686] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:42.003160 4010 raft_consensus.cc:2454] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:42.004026 4404 consensus_queue.cc:237] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.011744 3869 catalog_manager.cc:5495] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 1 to 2, leader changed from 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193) to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 2 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:42.035055 4408 raft_consensus.cc:979] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b: : Instructing follower 43e93bfb0c034b22803db3ee19e7c9f7 to start an election
I20260807 13:31:42.035466 4404 raft_consensus.cc:1067] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 1 LEADER]: Signalling peer 43e93bfb0c034b22803db3ee19e7c9f7 to start an election
I20260807 13:31:42.036792 4010 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
from {username='slave'} at 127.0.0.1:43304
I20260807 13:31:42.037212 4010 raft_consensus.cc:482] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:42.037478 4010 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.041432 4010 raft_consensus.cc:504] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.043330 4010 leader_election.cc:288] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 2 election: Requested vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:42.043999 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:42.044337 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:42.044620 4223 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.044881 4116 raft_consensus.cc:3032] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:31:42.045236 4116 raft_consensus.cc:729] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:42.045909 4116 consensus_queue.cc:260] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.046861 4116 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.050787 4116 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 2.
I20260807 13:31:42.051440 4223 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 2.
I20260807 13:31:42.051688 3957 leader_election.cc:302] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:42.052469 4326 raft_consensus.cc:2781] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:31:42.052907 4326 raft_consensus.cc:686] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 LEADER]: Becoming Leader. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:42.053718 4326 consensus_queue.cc:237] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.067276 3869 catalog_manager.cc:5495] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 reported cstate change: term changed from 1 to 2, leader changed from ca569eb2b573447f81328411193cfa3b (127.3.187.194) to 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193). New cstate: current_term: 2 leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:42.084115 4286 raft_consensus.cc:979] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7: : Instructing follower ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:42.085337 4326 raft_consensus.cc:1067] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Signalling peer ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:42.086959 4115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "101f669f72414b4b8251ae83a179e212"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:56888
I20260807 13:31:42.087535 4115 raft_consensus.cc:482] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:42.087898 4115 raft_consensus.cc:3037] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.092147 4115 raft_consensus.cc:504] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.093588 4115 leader_election.cc:288] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:42.094626 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:42.094527 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:42.095208 4010 raft_consensus.cc:3032] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:31:42.095467 4010 raft_consensus.cc:729] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:42.096112 4010 consensus_queue.cc:260] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.097003 4010 raft_consensus.cc:3037] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.100809 4223 raft_consensus.cc:3037] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.101411 4010 raft_consensus.cc:2454] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:42.102526 4061 leader_election.cc:302] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:42.103330 4404 raft_consensus.cc:2781] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:31:42.103785 4404 raft_consensus.cc:686] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:42.104590 4404 consensus_queue.cc:237] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.107868 4223 raft_consensus.cc:2454] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:42.111312 3869 catalog_manager.cc:5495] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 1 to 2, leader changed from 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193) to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 2 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:42.151827 4320 raft_consensus.cc:979] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda: : Instructing follower ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:42.152257 4410 raft_consensus.cc:1067] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 LEADER]: Signalling peer ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:42.153641 4115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:56904
I20260807 13:31:42.154177 4115 raft_consensus.cc:482] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:42.154458 4115 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.158918 4115 raft_consensus.cc:504] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.160311 4115 leader_election.cc:288] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:42.161309 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:42.161636 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:42.161898 4223 raft_consensus.cc:3032] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:31:42.162205 4010 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.162253 4223 raft_consensus.cc:729] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Running, Role: LEADER
I20260807 13:31:42.163058 4223 consensus_queue.cc:260] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.164187 4223 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:42.168421 4010 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:42.169446 4061 leader_election.cc:302] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:42.169982 4223 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:42.170295 4404 raft_consensus.cc:2781] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:31:42.170801 4404 raft_consensus.cc:686] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:42.171627 4404 consensus_queue.cc:237] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:42.178805 3869 catalog_manager.cc:5495] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 1 to 2, leader changed from cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195) to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 2 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:42.402325 4010 raft_consensus.cc:1261] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:42.403615 4404 consensus_queue.cc:1035] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:42.431725 4223 raft_consensus.cc:1261] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:42.433334 4408 consensus_queue.cc:1035] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:42.451579 4223 raft_consensus.cc:1261] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Refusing update from remote peer 43e93bfb0c034b22803db3ee19e7c9f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:42.455677 4326 consensus_queue.cc:1035] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:42.466830 4115 raft_consensus.cc:1261] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Refusing update from remote peer 43e93bfb0c034b22803db3ee19e7c9f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:42.468465 4286 consensus_queue.cc:1035] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:42.501667 4223 raft_consensus.cc:1261] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:42.502897 4404 consensus_queue.cc:1035] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:42.510491 4010 raft_consensus.cc:1261] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:42.511785 4404 consensus_queue.cc:1035] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:42.720038 4010 raft_consensus.cc:1261] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:42.721297 4404 consensus_queue.cc:1035] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:42.729965 4223 raft_consensus.cc:1261] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:42.731442 4404 consensus_queue.cc:1035] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:44.895697 3823 auto_leader_rebalancer-test.cc:269] The leader distribution is
I20260807 13:31:44.896556 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:44.915596 4010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
mode: GRACEFUL
new_leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
from {username='slave'} at 127.0.0.1:43332
I20260807 13:31:44.916254 4010 raft_consensus.cc:595] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 LEADER]: Received request to transfer leadership to TS cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:44.927573 4115 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
mode: GRACEFUL
new_leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
from {username='slave'} at 127.0.0.1:56934
I20260807 13:31:44.928074 4115 raft_consensus.cc:595] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Received request to transfer leadership to TS cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:44.929150 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 13:31:44.929594 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:45.204918 4404 raft_consensus.cc:979] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b: : Instructing follower cd82c0123f3f4e4ea9ecd97d6ff3aeda to start an election
I20260807 13:31:45.205510 4453 raft_consensus.cc:1067] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Signalling peer cd82c0123f3f4e4ea9ecd97d6ff3aeda to start an election
I20260807 13:31:45.207017 4223 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de"
dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
from {username='slave'} at 127.0.0.1:53778
I20260807 13:31:45.207486 4223 raft_consensus.cc:482] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:45.207844 4223 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:45.213898 4223 raft_consensus.cc:504] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:45.216135 4223 leader_election.cc:288] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 3 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:45.216778 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:45.217058 4115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:45.217594 4010 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:45.217716 4115 raft_consensus.cc:3032] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:31:45.218077 4115 raft_consensus.cc:729] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:45.218827 4115 consensus_queue.cc:260] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:45.219910 4115 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:45.223875 4010 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 3.
I20260807 13:31:45.225153 4167 leader_election.cc:302] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:45.226020 4115 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 3.
I20260807 13:31:45.226213 4454 raft_consensus.cc:2781] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:31:45.227543 4454 raft_consensus.cc:686] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Becoming Leader. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Running, Role: LEADER
I20260807 13:31:45.228271 4454 consensus_queue.cc:237] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:45.235596 3866 catalog_manager.cc:5495] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda reported cstate change: term changed from 2 to 3, leader changed from ca569eb2b573447f81328411193cfa3b (127.3.187.194) to cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195). New cstate: current_term: 3 leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260807 13:31:45.432462 4461 raft_consensus.cc:979] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7: : Instructing follower cd82c0123f3f4e4ea9ecd97d6ff3aeda to start an election
I20260807 13:31:45.433051 4286 raft_consensus.cc:1067] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 LEADER]: Signalling peer cd82c0123f3f4e4ea9ecd97d6ff3aeda to start an election
I20260807 13:31:45.434494 4226 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d"
dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
from {username='slave'} at 127.0.0.1:53768
I20260807 13:31:45.434962 4226 raft_consensus.cc:482] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:45.435315 4226 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:45.439760 4226 raft_consensus.cc:504] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:45.441105 4226 leader_election.cc:288] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 3 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:45.441982 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:45.442274 4115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:45.442582 4010 raft_consensus.cc:3032] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:31:45.442837 4115 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:45.442924 4010 raft_consensus.cc:729] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:45.443795 4010 consensus_queue.cc:260] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:45.444748 4010 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:45.447232 4115 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 3.
I20260807 13:31:45.448071 4167 leader_election.cc:302] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:45.448736 4454 raft_consensus.cc:2781] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:31:45.449110 4454 raft_consensus.cc:686] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Becoming Leader. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Running, Role: LEADER
I20260807 13:31:45.449313 4010 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 3.
I20260807 13:31:45.449922 4454 consensus_queue.cc:237] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:45.459342 3866 catalog_manager.cc:5495] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda reported cstate change: term changed from 2 to 3, leader changed from 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193) to cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195). New cstate: current_term: 3 leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260807 13:31:45.655205 4115 raft_consensus.cc:1261] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Refusing update from remote peer cd82c0123f3f4e4ea9ecd97d6ff3aeda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:45.656314 4454 consensus_queue.cc:1035] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:45.660652 4010 raft_consensus.cc:1261] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Refusing update from remote peer cd82c0123f3f4e4ea9ecd97d6ff3aeda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:45.661770 4454 consensus_queue.cc:1035] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:45.938463 4010 raft_consensus.cc:1261] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Refusing update from remote peer cd82c0123f3f4e4ea9ecd97d6ff3aeda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:45.939615 4454 consensus_queue.cc:1035] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:45.948096 4115 raft_consensus.cc:1261] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Refusing update from remote peer cd82c0123f3f4e4ea9ecd97d6ff3aeda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:45.950659 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:45.950448 4464 consensus_queue.cc:1035] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:45.958640 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:45.959115 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260807 13:31:46.358017 3908 debug-util.cc:398] Leaking SignalData structure 0x7b0800060060 after lost signal to thread 3828
W20260807 13:31:46.358793 3908 debug-util.cc:398] Leaking SignalData structure 0x7b0800060740 after lost signal to thread 3911
W20260807 13:31:46.359553 3908 debug-util.cc:398] Leaking SignalData structure 0x7b08001cba20 after lost signal to thread 4043
W20260807 13:31:46.360257 3908 debug-util.cc:398] Leaking SignalData structure 0x7b0800200f80 after lost signal to thread 4145
W20260807 13:31:46.360920 3908 debug-util.cc:398] Leaking SignalData structure 0x7b0800113800 after lost signal to thread 4253
I20260807 13:31:46.959995 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:46.967269 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:46.967717 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:47.968515 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:47.975147 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:47.975540 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:48.976378 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:48.981117 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:48.981607 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:49.982465 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:49.987663 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:49.988026 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:50.988722 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:50.993476 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:50.993886 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:51.994642 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:51.999428 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:51.999804 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:53.000483 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:53.005748 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:53.006119 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:54.006786 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:54.011523 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:54.011894 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:55.037554 3823 auto_leader_rebalancer-test.cc:288] The leader distribution is
I20260807 13:31:55.041898 4010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
mode: GRACEFUL
new_leader_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:43318
I20260807 13:31:55.042623 4010 raft_consensus.cc:595] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Received request to transfer leadership to TS ca569eb2b573447f81328411193cfa3b
I20260807 13:31:55.046943 4226 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d"
dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
mode: GRACEFUL
new_leader_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:53780
I20260807 13:31:55.047519 4226 raft_consensus.cc:595] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Received request to transfer leadership to TS ca569eb2b573447f81328411193cfa3b
I20260807 13:31:55.051541 4010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
mode: GRACEFUL
new_leader_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:43318
I20260807 13:31:55.051939 4010 raft_consensus.cc:595] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Received request to transfer leadership to TS ca569eb2b573447f81328411193cfa3b
I20260807 13:31:55.056324 4492 raft_consensus.cc:979] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: : Instructing follower ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.056314 4010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
mode: GRACEFUL
new_leader_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:43318
I20260807 13:31:55.056898 4010 raft_consensus.cc:595] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Received request to transfer leadership to TS ca569eb2b573447f81328411193cfa3b
I20260807 13:31:55.057001 4488 raft_consensus.cc:1067] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Signalling peer ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.058499 4115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:56904
I20260807 13:31:55.058928 4115 raft_consensus.cc:482] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:55.059269 4115 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:31:55.065692 4115 raft_consensus.cc:504] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.068856 4115 leader_election.cc:288] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 4 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:55.069186 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:55.069993 4010 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:31:55.070467 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:55.070930 4226 raft_consensus.cc:3032] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:31:55.071187 4226 raft_consensus.cc:729] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Running, Role: LEADER
I20260807 13:31:55.071756 4226 consensus_queue.cc:260] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.072685 4226 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:31:55.070358 4223 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de"
dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
mode: GRACEFUL
new_leader_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:53780
I20260807 13:31:55.074424 4223 raft_consensus.cc:595] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Received request to transfer leadership to TS ca569eb2b573447f81328411193cfa3b
I20260807 13:31:55.074389 4010 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 4.
I20260807 13:31:55.075798 4061 leader_election.cc:302] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:55.076683 4479 raft_consensus.cc:2781] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:31:55.077418 4226 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 4.
I20260807 13:31:55.078446 4479 raft_consensus.cc:686] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 4 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:55.079273 4479 consensus_queue.cc:237] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.085724 3866 catalog_manager.cc:5495] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 3 to 4, leader changed from cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195) to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 4 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:55.113708 4492 raft_consensus.cc:979] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda: : Instructing follower ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.114234 4488 raft_consensus.cc:1067] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Signalling peer ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.115219 4286 raft_consensus.cc:979] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7: : Instructing follower ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.115694 4508 raft_consensus.cc:1067] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Signalling peer ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.115724 4116 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:56904
I20260807 13:31:55.116259 4116 raft_consensus.cc:482] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:55.116580 4116 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:31:55.117161 4115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:56888
I20260807 13:31:55.117650 4115 raft_consensus.cc:482] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:55.117949 4115 raft_consensus.cc:3037] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:55.121455 4116 raft_consensus.cc:504] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.121698 4115 raft_consensus.cc:504] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.123005 4116 leader_election.cc:288] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 4 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:55.123271 4115 leader_election.cc:288] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:55.124179 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:55.124466 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bddc2fa18a784b7db6714c55d11c99de" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:55.124683 4226 raft_consensus.cc:3032] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:31:55.124603 4008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:55.124977 4010 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:31:55.125007 4226 raft_consensus.cc:729] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Running, Role: LEADER
I20260807 13:31:55.125195 4008 raft_consensus.cc:3032] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:31:55.125620 4008 raft_consensus.cc:729] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:55.124516 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84cae2afafb44f7282bf39d784f44b5d" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:55.126472 4223 raft_consensus.cc:3037] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:55.125840 4226 consensus_queue.cc:260] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.126472 4008 consensus_queue.cc:260] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.128134 4226 raft_consensus.cc:3037] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:31:55.128345 4008 raft_consensus.cc:3037] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:55.130987 4010 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 4.
I20260807 13:31:55.131906 4061 leader_election.cc:302] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:55.132731 4479 raft_consensus.cc:2781] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:31:55.133145 4479 raft_consensus.cc:686] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 4 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:55.133888 4226 raft_consensus.cc:2454] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 4.
I20260807 13:31:55.134192 4223 raft_consensus.cc:2454] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:55.134053 4479 consensus_queue.cc:237] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.135246 4008 raft_consensus.cc:2454] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:55.135442 4060 leader_election.cc:302] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:55.136348 4493 raft_consensus.cc:2781] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:31:55.140436 4493 raft_consensus.cc:686] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:55.141284 4493 consensus_queue.cc:237] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.142432 3866 catalog_manager.cc:5495] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 3 to 4, leader changed from cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195) to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 4 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:55.153163 3866 catalog_manager.cc:5495] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 1 to 2, leader changed from 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193) to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 2 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:55.228222 4286 raft_consensus.cc:979] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7: : Instructing follower ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.228701 4508 raft_consensus.cc:1067] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Signalling peer ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.230029 4115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:56888
I20260807 13:31:55.230592 4115 raft_consensus.cc:482] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:55.230955 4115 raft_consensus.cc:3037] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:55.234905 4115 raft_consensus.cc:504] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.236243 4115 leader_election.cc:288] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:55.236909 4008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:55.237128 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:55.237424 4008 raft_consensus.cc:3032] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:31:55.237664 4223 raft_consensus.cc:3037] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:55.237787 4008 raft_consensus.cc:729] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:55.238646 4008 consensus_queue.cc:260] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.239662 4008 raft_consensus.cc:3037] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:55.241479 4223 raft_consensus.cc:2454] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:55.242317 4060 leader_election.cc:302] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:55.243009 4493 raft_consensus.cc:2781] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:31:55.243412 4493 raft_consensus.cc:686] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:55.244185 4493 consensus_queue.cc:237] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.244503 4008 raft_consensus.cc:2454] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:55.250187 3866 catalog_manager.cc:5495] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 1 to 2, leader changed from 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193) to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 2 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:55.314323 4286 raft_consensus.cc:979] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7: : Instructing follower ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.314759 4508 raft_consensus.cc:1067] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Signalling peer ca569eb2b573447f81328411193cfa3b to start an election
I20260807 13:31:55.316305 4115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
from {username='slave'} at 127.0.0.1:56888
I20260807 13:31:55.316749 4115 raft_consensus.cc:482] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:55.317049 4115 raft_consensus.cc:3037] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:55.321516 4115 raft_consensus.cc:504] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.322890 4115 leader_election.cc:288] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:55.324025 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:55.324000 4008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "ca569eb2b573447f81328411193cfa3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:55.324641 4223 raft_consensus.cc:3037] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:55.324785 4008 raft_consensus.cc:3032] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:31:55.325240 4008 raft_consensus.cc:729] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:55.326287 4008 consensus_queue.cc:260] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.327718 4008 raft_consensus.cc:3037] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:31:55.328944 4223 raft_consensus.cc:2454] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:55.329777 4060 leader_election.cc:302] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca569eb2b573447f81328411193cfa3b, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:55.330478 4493 raft_consensus.cc:2781] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:31:55.331183 4493 raft_consensus.cc:686] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Leader. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:55.333127 4493 consensus_queue.cc:237] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:55.337530 4008 raft_consensus.cc:2454] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca569eb2b573447f81328411193cfa3b in term 2.
I20260807 13:31:55.345218 3866 catalog_manager.cc:5495] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b reported cstate change: term changed from 1 to 2, leader changed from 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193) to ca569eb2b573447f81328411193cfa3b (127.3.187.194). New cstate: current_term: 2 leader_uuid: "ca569eb2b573447f81328411193cfa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:55.488597 4223 raft_consensus.cc:1261] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 4 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:31:55.490078 4510 consensus_queue.cc:1035] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:31:55.507066 4008 raft_consensus.cc:1261] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 4 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:31:55.511438 4493 consensus_queue.cc:1035] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:31:55.554529 4008 raft_consensus.cc:1261] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:55.556381 4493 consensus_queue.cc:1035] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:55.559947 4223 raft_consensus.cc:1261] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:55.561219 4479 consensus_queue.cc:1035] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:55.591300 4008 raft_consensus.cc:1261] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 4 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:31:55.593034 4479 consensus_queue.cc:1035] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:31:55.606534 4223 raft_consensus.cc:1261] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 4 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:31:55.607736 4510 consensus_queue.cc:1035] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:31:55.680840 4223 raft_consensus.cc:1261] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:55.682054 4479 consensus_queue.cc:1035] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:55.695930 4008 raft_consensus.cc:1261] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:55.698042 4479 consensus_queue.cc:1035] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:31:55.789055 4008 raft_consensus.cc:1261] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:55.790557 4528 consensus_queue.cc:1035] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:31:55.804776 4223 raft_consensus.cc:1261] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Refusing update from remote peer ca569eb2b573447f81328411193cfa3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:31:55.806445 4493 consensus_queue.cc:1035] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:31:58.103381 3823 auto_leader_rebalancer-test.cc:303] The leader distribution is
I20260807 13:31:58.104004 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:58.110045 4115 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
mode: GRACEFUL
new_leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
from {username='slave'} at 127.0.0.1:56934
I20260807 13:31:58.110512 4115 raft_consensus.cc:595] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 4 LEADER]: Received request to transfer leadership to TS 43e93bfb0c034b22803db3ee19e7c9f7
I20260807 13:31:58.112473 4115 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "101f669f72414b4b8251ae83a179e212"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
mode: GRACEFUL
new_leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
from {username='slave'} at 127.0.0.1:56934
I20260807 13:31:58.112970 4115 raft_consensus.cc:595] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Received request to transfer leadership to TS cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:58.115077 4115 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
mode: GRACEFUL
new_leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
from {username='slave'} at 127.0.0.1:56934
I20260807 13:31:58.115480 4115 raft_consensus.cc:595] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Received request to transfer leadership to TS 43e93bfb0c034b22803db3ee19e7c9f7
I20260807 13:31:58.117336 4115 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
mode: GRACEFUL
new_leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
from {username='slave'} at 127.0.0.1:56934
I20260807 13:31:58.117672 4115 raft_consensus.cc:595] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Received request to transfer leadership to TS 43e93bfb0c034b22803db3ee19e7c9f7
I20260807 13:31:58.119451 4115 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056"
dest_uuid: "ca569eb2b573447f81328411193cfa3b"
mode: GRACEFUL
new_leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
from {username='slave'} at 127.0.0.1:56934
I20260807 13:31:58.119792 4115 raft_consensus.cc:595] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Received request to transfer leadership to TS cd82c0123f3f4e4ea9ecd97d6ff3aeda
I20260807 13:31:58.120599 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 13:31:58.121011 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:31:58.297978 4534 raft_consensus.cc:979] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b: : Instructing follower 43e93bfb0c034b22803db3ee19e7c9f7 to start an election
I20260807 13:31:58.298466 4493 raft_consensus.cc:1067] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Signalling peer 43e93bfb0c034b22803db3ee19e7c9f7 to start an election
I20260807 13:31:58.299594 4010 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
from {username='slave'} at 127.0.0.1:43304
I20260807 13:31:58.299970 4010 raft_consensus.cc:482] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:58.300215 4010 raft_consensus.cc:3037] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.304909 4493 raft_consensus.cc:979] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b: : Instructing follower 43e93bfb0c034b22803db3ee19e7c9f7 to start an election
I20260807 13:31:58.305372 4493 raft_consensus.cc:1067] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 4 LEADER]: Signalling peer 43e93bfb0c034b22803db3ee19e7c9f7 to start an election
I20260807 13:31:58.305831 4010 raft_consensus.cc:504] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.306720 4008 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
from {username='slave'} at 127.0.0.1:43304
I20260807 13:31:58.307305 4008 raft_consensus.cc:482] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:58.307641 4008 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:31:58.308139 4010 leader_election.cc:288] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 3 election: Requested vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:58.309123 4226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:58.309499 4226 raft_consensus.cc:3037] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.311936 4008 raft_consensus.cc:504] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.312765 4115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb94ba189e9423d872409088ac4e928" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:58.313191 4226 raft_consensus.cc:2454] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 3.
I20260807 13:31:58.313359 4115 raft_consensus.cc:3032] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:31:58.313740 4115 raft_consensus.cc:729] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:58.314124 4008 leader_election.cc:288] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 5 election: Requested vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:58.314240 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:58.314837 4116 raft_consensus.cc:3032] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:31:58.314725 3956 leader_election.cc:302] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:58.314630 4115 consensus_queue.cc:260] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.315209 4116 raft_consensus.cc:729] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:58.315449 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02900621b4f140998fc2964db01d9c8d" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:58.315830 4115 raft_consensus.cc:3037] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.315987 4223 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:31:58.315979 4116 consensus_queue.cc:260] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.317193 4116 raft_consensus.cc:3037] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:31:58.321655 4115 raft_consensus.cc:2454] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 3.
I20260807 13:31:58.323601 4116 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 5.
I20260807 13:31:58.323724 4535 raft_consensus.cc:2781] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:31:58.323773 4223 raft_consensus.cc:2454] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 5.
I20260807 13:31:58.324677 3957 leader_election.cc:302] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, ca569eb2b573447f81328411193cfa3b; no voters:
I20260807 13:31:58.325676 4535 raft_consensus.cc:686] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 LEADER]: Becoming Leader. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:58.326318 4537 raft_consensus.cc:2781] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:31:58.326797 4537 raft_consensus.cc:686] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 5 LEADER]: Becoming Leader. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:58.326692 4535 consensus_queue.cc:237] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.327592 4537 consensus_queue.cc:237] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.338820 3867 catalog_manager.cc:5495] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 reported cstate change: term changed from 2 to 3, leader changed from ca569eb2b573447f81328411193cfa3b (127.3.187.194) to 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193). New cstate: current_term: 3 leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:58.339864 3867 catalog_manager.cc:5495] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 reported cstate change: term changed from 4 to 5, leader changed from ca569eb2b573447f81328411193cfa3b (127.3.187.194) to 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193). New cstate: current_term: 5 leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:58.368378 4493 raft_consensus.cc:979] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b: : Instructing follower cd82c0123f3f4e4ea9ecd97d6ff3aeda to start an election
I20260807 13:31:58.368788 4534 raft_consensus.cc:1067] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Signalling peer cd82c0123f3f4e4ea9ecd97d6ff3aeda to start an election
I20260807 13:31:58.369999 4223 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "101f669f72414b4b8251ae83a179e212"
dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
from {username='slave'} at 127.0.0.1:53778
I20260807 13:31:58.370411 4223 raft_consensus.cc:482] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:58.370648 4223 raft_consensus.cc:3037] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.374833 4223 raft_consensus.cc:504] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.376349 4223 leader_election.cc:288] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 3 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:58.377105 4008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:58.377434 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101f669f72414b4b8251ae83a179e212" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:58.377671 4008 raft_consensus.cc:3037] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.377982 4116 raft_consensus.cc:3032] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:31:58.378309 4116 raft_consensus.cc:729] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:58.378995 4116 consensus_queue.cc:260] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.380124 4116 raft_consensus.cc:3037] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.383452 4008 raft_consensus.cc:2454] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 3.
I20260807 13:31:58.384574 4167 leader_election.cc:302] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:58.385363 4488 raft_consensus.cc:2781] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:31:58.386135 4116 raft_consensus.cc:2454] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 3.
I20260807 13:31:58.386495 4488 raft_consensus.cc:686] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Becoming Leader. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Running, Role: LEADER
I20260807 13:31:58.387388 4488 consensus_queue.cc:237] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.393479 3867 catalog_manager.cc:5495] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda reported cstate change: term changed from 2 to 3, leader changed from ca569eb2b573447f81328411193cfa3b (127.3.187.194) to cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195). New cstate: current_term: 3 leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260807 13:31:58.494130 4493 raft_consensus.cc:979] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b: : Instructing follower cd82c0123f3f4e4ea9ecd97d6ff3aeda to start an election
I20260807 13:31:58.494580 4534 raft_consensus.cc:1067] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Signalling peer cd82c0123f3f4e4ea9ecd97d6ff3aeda to start an election
I20260807 13:31:58.495793 4223 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056"
dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
from {username='slave'} at 127.0.0.1:53778
I20260807 13:31:58.496162 4223 raft_consensus.cc:482] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:58.496424 4223 raft_consensus.cc:3037] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.500535 4223 raft_consensus.cc:504] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.501679 4223 leader_election.cc:288] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 3 election: Requested vote from peers 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213), ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523)
I20260807 13:31:58.502707 4008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
I20260807 13:31:58.502774 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb302e43385b402da2ae60a60aa7d056" candidate_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:58.503335 4116 raft_consensus.cc:3032] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:31:58.503391 4008 raft_consensus.cc:3037] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.503701 4116 raft_consensus.cc:729] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:58.504427 4116 consensus_queue.cc:260] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.505541 4116 raft_consensus.cc:3037] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.508085 4008 raft_consensus.cc:2454] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 3.
I20260807 13:31:58.508846 4167 leader_election.cc:302] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:58.509466 4488 raft_consensus.cc:2781] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:31:58.509861 4488 raft_consensus.cc:686] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Becoming Leader. State: Replica: cd82c0123f3f4e4ea9ecd97d6ff3aeda, State: Running, Role: LEADER
I20260807 13:31:58.510421 4116 raft_consensus.cc:2454] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd82c0123f3f4e4ea9ecd97d6ff3aeda in term 3.
I20260807 13:31:58.510603 4488 consensus_queue.cc:237] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.517287 3869 catalog_manager.cc:5495] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda reported cstate change: term changed from 2 to 3, leader changed from ca569eb2b573447f81328411193cfa3b (127.3.187.194) to cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195). New cstate: current_term: 3 leader_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260807 13:31:58.536703 4493 raft_consensus.cc:979] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b: : Instructing follower 43e93bfb0c034b22803db3ee19e7c9f7 to start an election
I20260807 13:31:58.537147 4534 raft_consensus.cc:1067] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Signalling peer 43e93bfb0c034b22803db3ee19e7c9f7 to start an election
I20260807 13:31:58.538455 4008 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803"
dest_uuid: "43e93bfb0c034b22803db3ee19e7c9f7"
from {username='slave'} at 127.0.0.1:43304
I20260807 13:31:58.538959 4008 raft_consensus.cc:482] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:31:58.539291 4008 raft_consensus.cc:3037] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.543505 4008 raft_consensus.cc:504] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.544708 4008 leader_election.cc:288] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 3 election: Requested vote from peers ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523), cd82c0123f3f4e4ea9ecd97d6ff3aeda (127.3.187.195:39159)
I20260807 13:31:58.545434 4116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca569eb2b573447f81328411193cfa3b"
I20260807 13:31:58.545606 4223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8767ec640d6c462bbb78cd12f8d77803" candidate_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda"
I20260807 13:31:58.545985 4116 raft_consensus.cc:3032] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:31:58.546052 4223 raft_consensus.cc:3037] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.546401 4116 raft_consensus.cc:729] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca569eb2b573447f81328411193cfa3b, State: Running, Role: LEADER
I20260807 13:31:58.547148 4116 consensus_queue.cc:260] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.548317 4116 raft_consensus.cc:3037] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:31:58.551914 4223 raft_consensus.cc:2454] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 3.
I20260807 13:31:58.552798 3956 leader_election.cc:302] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43e93bfb0c034b22803db3ee19e7c9f7, cd82c0123f3f4e4ea9ecd97d6ff3aeda; no voters:
I20260807 13:31:58.553429 4537 raft_consensus.cc:2781] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:31:58.553931 4537 raft_consensus.cc:686] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 LEADER]: Becoming Leader. State: Replica: 43e93bfb0c034b22803db3ee19e7c9f7, State: Running, Role: LEADER
I20260807 13:31:58.554095 4116 raft_consensus.cc:2454] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43e93bfb0c034b22803db3ee19e7c9f7 in term 3.
I20260807 13:31:58.554782 4537 consensus_queue.cc:237] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } }
I20260807 13:31:58.560863 3869 catalog_manager.cc:5495] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 reported cstate change: term changed from 2 to 3, leader changed from ca569eb2b573447f81328411193cfa3b (127.3.187.194) to 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193). New cstate: current_term: 3 leader_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260807 13:31:58.795403 4223 raft_consensus.cc:1261] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 5 FOLLOWER]: Refusing update from remote peer 43e93bfb0c034b22803db3ee19e7c9f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:31:58.796545 4537 consensus_queue.cc:1035] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:31:58.800940 4116 raft_consensus.cc:1261] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 5 FOLLOWER]: Refusing update from remote peer 43e93bfb0c034b22803db3ee19e7c9f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:31:58.802347 4537 consensus_queue.cc:1035] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:31:58.841964 4116 raft_consensus.cc:1261] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Refusing update from remote peer cd82c0123f3f4e4ea9ecd97d6ff3aeda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:58.843222 4488 consensus_queue.cc:1035] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:58.851043 4008 raft_consensus.cc:1261] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Refusing update from remote peer cd82c0123f3f4e4ea9ecd97d6ff3aeda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:58.852415 4545 consensus_queue.cc:1035] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:58.883769 4116 raft_consensus.cc:1261] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Refusing update from remote peer 43e93bfb0c034b22803db3ee19e7c9f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:58.884791 4537 consensus_queue.cc:1035] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:58.892082 4223 raft_consensus.cc:1261] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Refusing update from remote peer 43e93bfb0c034b22803db3ee19e7c9f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:58.893625 4535 consensus_queue.cc:1035] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:58.953286 4116 raft_consensus.cc:1261] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Refusing update from remote peer 43e93bfb0c034b22803db3ee19e7c9f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:58.954770 4536 consensus_queue.cc:1035] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:58.962733 4223 raft_consensus.cc:1261] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Refusing update from remote peer 43e93bfb0c034b22803db3ee19e7c9f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:58.964794 4535 consensus_queue.cc:1035] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd82c0123f3f4e4ea9ecd97d6ff3aeda" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:31:59.019348 4008 raft_consensus.cc:1261] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Refusing update from remote peer cd82c0123f3f4e4ea9ecd97d6ff3aeda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:59.020448 4545 consensus_queue.cc:1035] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "43e93bfb0c034b22803db3ee19e7c9f7" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 38213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:59.036475 4116 raft_consensus.cc:1261] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Refusing update from remote peer cd82c0123f3f4e4ea9ecd97d6ff3aeda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:31:59.038251 4488 consensus_queue.cc:1035] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca569eb2b573447f81328411193cfa3b" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 36523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:31:59.121732 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:31:59.126282 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:31:59.126628 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:00.127377 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:00.132289 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:00.132668 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:01.133519 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:01.138197 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:01.138624 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:02.139617 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:02.146240 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:02.146775 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:03.147650 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:03.152767 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:03.153203 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:04.153950 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:04.159916 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:04.160356 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:05.161288 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:05.166520 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:05.166868 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:06.167521 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:06.173295 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:06.173607 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:07.174379 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:07.178814 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:07.179126 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:08.213806 3823 auto_leader_rebalancer-test.cc:314] The leader distribution is
I20260807 13:32:08.214704 3823 tablet_server.cc:178] TabletServer@127.3.187.193:0 shutting down...
I20260807 13:32:08.259869 3823 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:32:08.260520 3823 tablet_replica.cc:330] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7: stopping tablet replica
I20260807 13:32:08.261258 3823 raft_consensus.cc:2229] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 5 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.262279 3823 raft_consensus.cc:2258] T 02900621b4f140998fc2964db01d9c8d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.264618 3823 tablet_replica.cc:330] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7: stopping tablet replica
I20260807 13:32:08.265120 3823 raft_consensus.cc:2229] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.265540 3823 raft_consensus.cc:2258] T 3a65b1f7710a4094a15b7a1239ee20df P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.267093 3823 tablet_replica.cc:330] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7: stopping tablet replica
I20260807 13:32:08.267575 3823 raft_consensus.cc:2229] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.268033 3823 raft_consensus.cc:2258] T fb302e43385b402da2ae60a60aa7d056 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.269537 3823 tablet_replica.cc:330] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7: stopping tablet replica
I20260807 13:32:08.269985 3823 raft_consensus.cc:2229] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.270447 3823 raft_consensus.cc:2258] T 101f669f72414b4b8251ae83a179e212 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.272118 3823 tablet_replica.cc:330] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7: stopping tablet replica
I20260807 13:32:08.272591 3823 raft_consensus.cc:2229] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.273336 3823 raft_consensus.cc:2258] T 8767ec640d6c462bbb78cd12f8d77803 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.275013 3823 tablet_replica.cc:330] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7: stopping tablet replica
I20260807 13:32:08.275415 3823 raft_consensus.cc:2229] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.275785 3823 raft_consensus.cc:2258] T 13202f85621849e486b6c76a7dea3195 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.277261 3823 tablet_replica.cc:330] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7: stopping tablet replica
I20260807 13:32:08.277675 3823 raft_consensus.cc:2229] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.278000 3823 raft_consensus.cc:2258] T bddc2fa18a784b7db6714c55d11c99de P 43e93bfb0c034b22803db3ee19e7c9f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.279487 3823 tablet_replica.cc:330] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7: stopping tablet replica
I20260807 13:32:08.279876 3823 raft_consensus.cc:2229] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.280654 3823 raft_consensus.cc:2258] T eeb94ba189e9423d872409088ac4e928 P 43e93bfb0c034b22803db3ee19e7c9f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.282241 3823 tablet_replica.cc:330] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7: stopping tablet replica
I20260807 13:32:08.282665 3823 raft_consensus.cc:2229] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.283087 3823 raft_consensus.cc:2258] T 84cae2afafb44f7282bf39d784f44b5d P 43e93bfb0c034b22803db3ee19e7c9f7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260807 13:32:08.285933 4167 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260807 13:32:08.289368 4167 consensus_peers.cc:487] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda -> Peer 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213): Couldn't send request to peer 43e93bfb0c034b22803db3ee19e7c9f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:08.415694 3823 tablet_server.cc:194] TabletServer@127.3.187.193:0 shutdown complete.
W20260807 13:32:08.417693 4061 consensus_peers.cc:487] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b -> Peer 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213): Couldn't send request to peer 43e93bfb0c034b22803db3ee19e7c9f7. Status: Network error: Client connection negotiation failed: client connection to 127.3.187.193:38213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:32:08.417985 4167 consensus_peers.cc:487] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda -> Peer 43e93bfb0c034b22803db3ee19e7c9f7 (127.3.187.193:38213): Couldn't send request to peer 43e93bfb0c034b22803db3ee19e7c9f7. Status: Network error: Client connection negotiation failed: client connection to 127.3.187.193:38213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:08.434084 3823 tablet_server.cc:178] TabletServer@127.3.187.194:0 shutting down...
I20260807 13:32:08.461040 3823 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:32:08.461644 3823 tablet_replica.cc:330] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b: stopping tablet replica
I20260807 13:32:08.462302 3823 raft_consensus.cc:2229] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 4 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.463135 3823 raft_consensus.cc:2258] T bddc2fa18a784b7db6714c55d11c99de P ca569eb2b573447f81328411193cfa3b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.464927 3823 tablet_replica.cc:330] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b: stopping tablet replica
I20260807 13:32:08.465461 3823 raft_consensus.cc:2229] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.466261 3823 raft_consensus.cc:2258] T 84cae2afafb44f7282bf39d784f44b5d P ca569eb2b573447f81328411193cfa3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.467761 3823 tablet_replica.cc:330] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b: stopping tablet replica
I20260807 13:32:08.468266 3823 raft_consensus.cc:2229] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.468688 3823 raft_consensus.cc:2258] T fb302e43385b402da2ae60a60aa7d056 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.470273 3823 tablet_replica.cc:330] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b: stopping tablet replica
I20260807 13:32:08.470748 3823 raft_consensus.cc:2229] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.471174 3823 raft_consensus.cc:2258] T 101f669f72414b4b8251ae83a179e212 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.472872 3823 tablet_replica.cc:330] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b: stopping tablet replica
I20260807 13:32:08.473464 3823 raft_consensus.cc:2229] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.473979 3823 raft_consensus.cc:2258] T 8767ec640d6c462bbb78cd12f8d77803 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.476166 3823 tablet_replica.cc:330] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b: stopping tablet replica
I20260807 13:32:08.476610 3823 raft_consensus.cc:2229] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.476985 3823 raft_consensus.cc:2258] T 13202f85621849e486b6c76a7dea3195 P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.478506 3823 tablet_replica.cc:330] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b: stopping tablet replica
I20260807 13:32:08.478920 3823 raft_consensus.cc:2229] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.479624 3823 raft_consensus.cc:2258] T 3a65b1f7710a4094a15b7a1239ee20df P ca569eb2b573447f81328411193cfa3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.481343 3823 tablet_replica.cc:330] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b: stopping tablet replica
I20260807 13:32:08.481798 3823 raft_consensus.cc:2229] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.482267 3823 raft_consensus.cc:2258] T eeb94ba189e9423d872409088ac4e928 P ca569eb2b573447f81328411193cfa3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.483740 3823 tablet_replica.cc:330] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b: stopping tablet replica
I20260807 13:32:08.484131 3823 raft_consensus.cc:2229] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.484553 3823 raft_consensus.cc:2258] T 02900621b4f140998fc2964db01d9c8d P ca569eb2b573447f81328411193cfa3b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.512771 3823 tablet_server.cc:194] TabletServer@127.3.187.194:0 shutdown complete.
I20260807 13:32:08.530181 3823 tablet_server.cc:178] TabletServer@127.3.187.195:0 shutting down...
W20260807 13:32:08.541996 4167 consensus_peers.cc:487] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda -> Peer ca569eb2b573447f81328411193cfa3b (127.3.187.194:36523): Couldn't send request to peer ca569eb2b573447f81328411193cfa3b. Status: Network error: Client connection negotiation failed: client connection to 127.3.187.194:36523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:08.561034 3823 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:32:08.561730 3823 tablet_replica.cc:330] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda: stopping tablet replica
I20260807 13:32:08.562702 3823 raft_consensus.cc:2229] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.563257 3823 raft_consensus.cc:2258] T 3a65b1f7710a4094a15b7a1239ee20df P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.565126 3823 tablet_replica.cc:330] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda: stopping tablet replica
I20260807 13:32:08.565621 3823 raft_consensus.cc:2229] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.566051 3823 raft_consensus.cc:2258] T bddc2fa18a784b7db6714c55d11c99de P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.567636 3823 tablet_replica.cc:330] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: stopping tablet replica
I20260807 13:32:08.568121 3823 raft_consensus.cc:2229] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.568848 3823 raft_consensus.cc:2258] T fb302e43385b402da2ae60a60aa7d056 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.570441 3823 tablet_replica.cc:330] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: stopping tablet replica
I20260807 13:32:08.570909 3823 raft_consensus.cc:2229] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.571332 3823 raft_consensus.cc:2258] T 02900621b4f140998fc2964db01d9c8d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.572916 3823 tablet_replica.cc:330] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda: stopping tablet replica
I20260807 13:32:08.573392 3823 raft_consensus.cc:2229] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.573768 3823 raft_consensus.cc:2258] T 84cae2afafb44f7282bf39d784f44b5d P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.575322 3823 tablet_replica.cc:330] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: stopping tablet replica
I20260807 13:32:08.575760 3823 raft_consensus.cc:2229] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.576134 3823 raft_consensus.cc:2258] T 8767ec640d6c462bbb78cd12f8d77803 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.577581 3823 tablet_replica.cc:330] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: stopping tablet replica
I20260807 13:32:08.578006 3823 raft_consensus.cc:2229] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.578711 3823 raft_consensus.cc:2258] T 13202f85621849e486b6c76a7dea3195 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.580128 3823 tablet_replica.cc:330] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: stopping tablet replica
I20260807 13:32:08.580549 3823 raft_consensus.cc:2229] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.581249 3823 raft_consensus.cc:2258] T 101f669f72414b4b8251ae83a179e212 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.582850 3823 tablet_replica.cc:330] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda: stopping tablet replica
I20260807 13:32:08.583259 3823 raft_consensus.cc:2229] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:08.583653 3823 raft_consensus.cc:2258] T eeb94ba189e9423d872409088ac4e928 P cd82c0123f3f4e4ea9ecd97d6ff3aeda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.627480 3823 tablet_server.cc:194] TabletServer@127.3.187.195:0 shutdown complete.
I20260807 13:32:08.644747 3823 master.cc:537] Master@127.3.187.254:40561 shutting down...
I20260807 13:32:08.857584 3823 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:32:08.858294 3823 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:08.858737 3823 tablet_replica.cc:330] T 00000000000000000000000000000000 P d71e2d21b7db43a9bac0cb7366b53af6: stopping tablet replica
I20260807 13:32:08.891860 3823 master.cc:552] Master@127.3.187.254:40561 shutdown complete.
43e93bfb0c034b22803db3ee19e7c9f7 4
ca569eb2b573447f81328411193cfa3b 4
cd82c0123f3f4e4ea9ecd97d6ff3aeda 1
43e93bfb0c034b22803db3ee19e7c9f7 3
ca569eb2b573447f81328411193cfa3b 3
cd82c0123f3f4e4ea9ecd97d6ff3aeda 3
43e93bfb0c034b22803db3ee19e7c9f7 0
ca569eb2b573447f81328411193cfa3b 8
cd82c0123f3f4e4ea9ecd97d6ff3aeda 1
43e93bfb0c034b22803db3ee19e7c9f7 3
ca569eb2b573447f81328411193cfa3b 3
cd82c0123f3f4e4ea9ecd97d6ff3aeda 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (34559 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260807 13:32:08.934505 3823 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.187.254:41407
I20260807 13:32:08.935685 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:32:08.941351 4588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:08.942824 4589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:08.943552 4593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:08.944317 3823 server_base.cc:1034] running on GCE node
I20260807 13:32:08.945309 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:32:08.945518 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:32:08.945696 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109528945675 us; error 0 us; skew 500 ppm
I20260807 13:32:08.946236 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:32:08.951524 3823 webserver.cc:460] Webserver started at http://127.3.187.254:41575/ using document root <none> and password file <none>
I20260807 13:32:08.951978 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:32:08.952241 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:32:08.952541 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:32:08.953734 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/master-0-root/instance:
uuid: "c18db01974f349cfa802dde8b6a33c49"
format_stamp: "Formatted at 2026-08-07 13:32:08 on dist-test-slave-d17x"
I20260807 13:32:08.958081 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 13:32:08.961252 4599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:08.961908 3823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260807 13:32:08.962258 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/master-0-root
uuid: "c18db01974f349cfa802dde8b6a33c49"
format_stamp: "Formatted at 2026-08-07 13:32:08 on dist-test-slave-d17x"
I20260807 13:32:08.962522 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:32:08.997988 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:32:08.999202 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:32:09.037173 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.254:41407
I20260807 13:32:09.037276 4668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.254:41407 every 8 connection(s)
I20260807 13:32:09.041023 4669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.049995 4669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49: Bootstrap starting.
I20260807 13:32:09.054396 4669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.058370 4669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49: No bootstrap required, opened a new log
I20260807 13:32:09.060324 4669 raft_consensus.cc:348] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18db01974f349cfa802dde8b6a33c49" member_type: VOTER }
I20260807 13:32:09.060791 4669 raft_consensus.cc:374] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.061020 4669 raft_consensus.cc:729] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18db01974f349cfa802dde8b6a33c49, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.061563 4669 consensus_queue.cc:260] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18db01974f349cfa802dde8b6a33c49" member_type: VOTER }
I20260807 13:32:09.061995 4669 raft_consensus.cc:388] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:32:09.062278 4669 raft_consensus.cc:482] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:32:09.062551 4669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:09.066246 4669 raft_consensus.cc:504] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18db01974f349cfa802dde8b6a33c49" member_type: VOTER }
I20260807 13:32:09.066730 4669 leader_election.cc:302] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c18db01974f349cfa802dde8b6a33c49; no voters:
I20260807 13:32:09.067764 4669 leader_election.cc:288] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:32:09.068121 4672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:09.069491 4672 raft_consensus.cc:686] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 1 LEADER]: Becoming Leader. State: Replica: c18db01974f349cfa802dde8b6a33c49, State: Running, Role: LEADER
I20260807 13:32:09.070060 4672 consensus_queue.cc:237] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18db01974f349cfa802dde8b6a33c49" member_type: VOTER }
I20260807 13:32:09.070578 4669 sys_catalog.cc:564] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:32:09.075052 4674 sys_catalog.cc:455] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c18db01974f349cfa802dde8b6a33c49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18db01974f349cfa802dde8b6a33c49" member_type: VOTER } }
I20260807 13:32:09.075383 4675 sys_catalog.cc:455] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c18db01974f349cfa802dde8b6a33c49. Latest consensus state: current_term: 1 leader_uuid: "c18db01974f349cfa802dde8b6a33c49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18db01974f349cfa802dde8b6a33c49" member_type: VOTER } }
I20260807 13:32:09.075822 4674 sys_catalog.cc:458] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [sys.catalog]: This master's current role is: LEADER
I20260807 13:32:09.076205 4675 sys_catalog.cc:458] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [sys.catalog]: This master's current role is: LEADER
I20260807 13:32:09.081100 4685 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 13:32:09.085920 4685 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 13:32:09.087275 3823 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 13:32:09.094152 4685 catalog_manager.cc:1347] Generated new cluster ID: 298a848b127140b6bdcb88d1a96a96c4
I20260807 13:32:09.094409 4685 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 13:32:09.113209 4685 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 13:32:09.114722 4685 catalog_manager.cc:1504] Loading token signing keys...
I20260807 13:32:09.127781 4685 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49: Generated new TSK 0
I20260807 13:32:09.128381 4685 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 13:32:09.153121 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:32:09.158778 4697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:09.159919 4698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:09.161713 3823 server_base.cc:1034] running on GCE node
W20260807 13:32:09.161852 4700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:09.163039 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:32:09.163213 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:32:09.163355 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109529163336 us; error 0 us; skew 500 ppm
I20260807 13:32:09.163913 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:32:09.166188 3823 webserver.cc:460] Webserver started at http://127.3.187.193:40627/ using document root <none> and password file <none>
I20260807 13:32:09.166672 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:32:09.166867 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:32:09.167124 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:32:09.168131 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-0-root/instance:
uuid: "c8c665d676074226af419c349506f887"
format_stamp: "Formatted at 2026-08-07 13:32:09 on dist-test-slave-d17x"
I20260807 13:32:09.172892 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 13:32:09.176077 4706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:09.176759 3823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 13:32:09.177047 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-0-root
uuid: "c8c665d676074226af419c349506f887"
format_stamp: "Formatted at 2026-08-07 13:32:09 on dist-test-slave-d17x"
I20260807 13:32:09.177323 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:32:09.201539 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:32:09.202703 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:32:09.204130 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:32:09.206331 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:32:09.206532 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:09.206784 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:32:09.206957 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:09.247869 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.193:43021
I20260807 13:32:09.247972 4803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.193:43021 every 8 connection(s)
I20260807 13:32:09.254267 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:32:09.260357 4808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:09.261400 4812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:09.264638 3823 server_base.cc:1034] running on GCE node
W20260807 13:32:09.265040 4815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:09.266165 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:32:09.266433 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:32:09.266626 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109529266611 us; error 0 us; skew 500 ppm
I20260807 13:32:09.267136 4804 heartbeater.cc:347] Connected to a master server at 127.3.187.254:41407
I20260807 13:32:09.267256 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:32:09.267459 4804 heartbeater.cc:464] Registering TS with master...
I20260807 13:32:09.268179 4804 heartbeater.cc:511] Master 127.3.187.254:41407 requested a full tablet report, sending...
I20260807 13:32:09.269979 3823 webserver.cc:460] Webserver started at http://127.3.187.194:33747/ using document root <none> and password file <none>
I20260807 13:32:09.270592 4625 ts_manager.cc:194] Registered new tserver with Master: c8c665d676074226af419c349506f887 (127.3.187.193:43021)
I20260807 13:32:09.270704 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:32:09.271000 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:32:09.271410 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:32:09.272771 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-1-root/instance:
uuid: "a873f49ccdd84afd86937a5ff9a30503"
format_stamp: "Formatted at 2026-08-07 13:32:09 on dist-test-slave-d17x"
I20260807 13:32:09.273249 4625 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55144
I20260807 13:32:09.277426 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 13:32:09.280864 4823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:09.281688 3823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 13:32:09.281909 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-1-root
uuid: "a873f49ccdd84afd86937a5ff9a30503"
format_stamp: "Formatted at 2026-08-07 13:32:09 on dist-test-slave-d17x"
I20260807 13:32:09.282207 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:32:09.292418 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:32:09.293380 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:32:09.294708 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:32:09.296689 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:32:09.296856 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:09.297112 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:32:09.297258 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:09.335500 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.194:35587
I20260807 13:32:09.335609 4919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.194:35587 every 8 connection(s)
I20260807 13:32:09.340159 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:32:09.346927 4926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:09.350395 4927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:09.350798 4930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:09.351082 3823 server_base.cc:1034] running on GCE node
I20260807 13:32:09.352232 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:32:09.352499 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:32:09.352695 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109529352663 us; error 0 us; skew 500 ppm
I20260807 13:32:09.353394 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:32:09.355332 4921 heartbeater.cc:347] Connected to a master server at 127.3.187.254:41407
I20260807 13:32:09.355676 4921 heartbeater.cc:464] Registering TS with master...
I20260807 13:32:09.356333 3823 webserver.cc:460] Webserver started at http://127.3.187.195:45267/ using document root <none> and password file <none>
I20260807 13:32:09.356419 4921 heartbeater.cc:511] Master 127.3.187.254:41407 requested a full tablet report, sending...
I20260807 13:32:09.356948 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:32:09.357226 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:32:09.357582 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:32:09.358728 4625 ts_manager.cc:194] Registered new tserver with Master: a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:09.359133 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-2-root/instance:
uuid: "599c0b06734d46dba4877a2de293bb16"
format_stamp: "Formatted at 2026-08-07 13:32:09 on dist-test-slave-d17x"
I20260807 13:32:09.361021 4625 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55154
I20260807 13:32:09.364756 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 13:32:09.367827 4935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:09.368549 3823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 13:32:09.368831 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-2-root
uuid: "599c0b06734d46dba4877a2de293bb16"
format_stamp: "Formatted at 2026-08-07 13:32:09 on dist-test-slave-d17x"
I20260807 13:32:09.369102 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786109494203502-3823-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:32:09.385871 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:32:09.387055 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:32:09.388439 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:32:09.390575 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:32:09.390749 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:09.391041 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:32:09.391194 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:09.434707 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.195:36775
I20260807 13:32:09.434814 5029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.195:36775 every 8 connection(s)
I20260807 13:32:09.449748 5033 heartbeater.cc:347] Connected to a master server at 127.3.187.254:41407
I20260807 13:32:09.450158 5033 heartbeater.cc:464] Registering TS with master...
I20260807 13:32:09.450793 5033 heartbeater.cc:511] Master 127.3.187.254:41407 requested a full tablet report, sending...
I20260807 13:32:09.452584 4625 ts_manager.cc:194] Registered new tserver with Master: 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:09.453679 3823 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015584553s
I20260807 13:32:09.454329 4625 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55170
I20260807 13:32:09.456313 3823 test_util.cc:268] Using random seed: 134774434
I20260807 13:32:09.480037 4625 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55184:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 13:32:09.483486 4625 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 13:32:09.569793 4874 tablet_service.cc:1467] Processing CreateTablet for tablet 4c15b7a03dc74874adde4ceeaad27dc0 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 13:32:09.570258 4871 tablet_service.cc:1467] Processing CreateTablet for tablet e8e2623235a5400ebe1df26bbd12e291 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 13:32:09.571323 4874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c15b7a03dc74874adde4ceeaad27dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.572403 4870 tablet_service.cc:1467] Processing CreateTablet for tablet 08ad3a8f426f4f6fba240b0dc96ee255 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 13:32:09.573704 4870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ad3a8f426f4f6fba240b0dc96ee255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.579118 4869 tablet_service.cc:1467] Processing CreateTablet for tablet 366df500c3634b0180c70a000da5c1d7 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 13:32:09.580396 4869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 366df500c3634b0180c70a000da5c1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.568836 4872 tablet_service.cc:1467] Processing CreateTablet for tablet 146ee52a9e2f4d8b8146f273bfe20c2e (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 13:32:09.584122 4872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 146ee52a9e2f4d8b8146f273bfe20c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.585656 4978 tablet_service.cc:1467] Processing CreateTablet for tablet 4c15b7a03dc74874adde4ceeaad27dc0 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 13:32:09.586570 4871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e2623235a5400ebe1df26bbd12e291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.586938 4978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c15b7a03dc74874adde4ceeaad27dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.598640 4977 tablet_service.cc:1467] Processing CreateTablet for tablet 146ee52a9e2f4d8b8146f273bfe20c2e (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 13:32:09.600306 4977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 146ee52a9e2f4d8b8146f273bfe20c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.603413 4749 tablet_service.cc:1467] Processing CreateTablet for tablet 08ad3a8f426f4f6fba240b0dc96ee255 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 13:32:09.605087 4749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ad3a8f426f4f6fba240b0dc96ee255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.610443 4974 tablet_service.cc:1467] Processing CreateTablet for tablet 366df500c3634b0180c70a000da5c1d7 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 13:32:09.611774 4974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 366df500c3634b0180c70a000da5c1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.611945 5050 tablet_bootstrap.cc:492] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
I20260807 13:32:09.613138 4975 tablet_service.cc:1467] Processing CreateTablet for tablet 08ad3a8f426f4f6fba240b0dc96ee255 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 13:32:09.614517 4975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ad3a8f426f4f6fba240b0dc96ee255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.614969 4750 tablet_service.cc:1467] Processing CreateTablet for tablet e8e2623235a5400ebe1df26bbd12e291 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 13:32:09.616210 4750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e2623235a5400ebe1df26bbd12e291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.619025 4748 tablet_service.cc:1467] Processing CreateTablet for tablet 366df500c3634b0180c70a000da5c1d7 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 13:32:09.619876 5050 tablet_bootstrap.cc:654] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.620239 4748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 366df500c3634b0180c70a000da5c1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.623327 4976 tablet_service.cc:1467] Processing CreateTablet for tablet e8e2623235a5400ebe1df26bbd12e291 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 13:32:09.624603 4976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e2623235a5400ebe1df26bbd12e291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.634315 4742 tablet_service.cc:1467] Processing CreateTablet for tablet 5a0f46c814924b0e92ab52c2152465a1 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 13:32:09.635934 4742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a0f46c814924b0e92ab52c2152465a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.648478 4970 tablet_service.cc:1467] Processing CreateTablet for tablet 5a0f46c814924b0e92ab52c2152465a1 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 13:32:09.649806 4970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a0f46c814924b0e92ab52c2152465a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.655143 4973 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed4d9054df34376a505c804320f61e4 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 13:32:09.656420 4973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed4d9054df34376a505c804320f61e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.659153 4743 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed4d9054df34376a505c804320f61e4 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 13:32:09.660388 4743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed4d9054df34376a505c804320f61e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.663090 4752 tablet_service.cc:1467] Processing CreateTablet for tablet 146ee52a9e2f4d8b8146f273bfe20c2e (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 13:32:09.664315 4752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 146ee52a9e2f4d8b8146f273bfe20c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.611023 4753 tablet_service.cc:1467] Processing CreateTablet for tablet 4c15b7a03dc74874adde4ceeaad27dc0 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 13:32:09.667383 4753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c15b7a03dc74874adde4ceeaad27dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.683687 4969 tablet_service.cc:1467] Processing CreateTablet for tablet 4e0c46a5d3a94fee84a44720af8d30bd (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 13:32:09.684989 4969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e0c46a5d3a94fee84a44720af8d30bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.691226 4874 tablet_service.cc:1467] Processing CreateTablet for tablet 4e0c46a5d3a94fee84a44720af8d30bd (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 13:32:09.692497 4874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e0c46a5d3a94fee84a44720af8d30bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.697536 5052 tablet_bootstrap.cc:492] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:09.698769 4870 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed4d9054df34376a505c804320f61e4 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 13:32:09.699949 4870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed4d9054df34376a505c804320f61e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.705860 4967 tablet_service.cc:1467] Processing CreateTablet for tablet 3ca69c36b4e44b7bb5529010fcc63122 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 13:32:09.706230 4740 tablet_service.cc:1467] Processing CreateTablet for tablet 3ca69c36b4e44b7bb5529010fcc63122 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 13:32:09.706800 5055 tablet_bootstrap.cc:492] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:09.707249 4967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ca69c36b4e44b7bb5529010fcc63122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.707559 4740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ca69c36b4e44b7bb5529010fcc63122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.708841 5050 tablet_bootstrap.cc:492] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:09.709290 5050 ts_tablet_manager.cc:1397] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.099s user 0.025s sys 0.034s
I20260807 13:32:09.712078 4872 tablet_service.cc:1467] Processing CreateTablet for tablet 3ca69c36b4e44b7bb5529010fcc63122 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 13:32:09.713260 4872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ca69c36b4e44b7bb5529010fcc63122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.712841 5050 raft_consensus.cc:348] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:09.713618 5050 raft_consensus.cc:374] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.713927 5050 raft_consensus.cc:729] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.717254 5050 consensus_queue.cc:260] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:09.717545 5055 tablet_bootstrap.cc:654] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.707284 4869 tablet_service.cc:1467] Processing CreateTablet for tablet 5a0f46c814924b0e92ab52c2152465a1 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 13:32:09.738541 4869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a0f46c814924b0e92ab52c2152465a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.748799 4748 tablet_service.cc:1467] Processing CreateTablet for tablet 038d9af0b5d6451fb19a7bc99107fee0 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 13:32:09.750084 4748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 038d9af0b5d6451fb19a7bc99107fee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.750928 5052 tablet_bootstrap.cc:654] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.756533 4753 tablet_service.cc:1467] Processing CreateTablet for tablet 4e0c46a5d3a94fee84a44720af8d30bd (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 13:32:09.757707 4753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e0c46a5d3a94fee84a44720af8d30bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.761978 4921 heartbeater.cc:503] Master 127.3.187.254:41407 was elected leader, sending a full tablet report...
I20260807 13:32:09.762310 5050 ts_tablet_manager.cc:1428] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.053s user 0.015s sys 0.016s
I20260807 13:32:09.763202 5050 tablet_bootstrap.cc:492] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
I20260807 13:32:09.766009 4977 tablet_service.cc:1467] Processing CreateTablet for tablet 038d9af0b5d6451fb19a7bc99107fee0 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 13:32:09.778354 4977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 038d9af0b5d6451fb19a7bc99107fee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.768416 4870 tablet_service.cc:1467] Processing CreateTablet for tablet 038d9af0b5d6451fb19a7bc99107fee0 (DEFAULT_TABLE table=test-workload [id=2507f42ad61143dcaa1ac7ccfc326959]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 13:32:09.784914 4870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 038d9af0b5d6451fb19a7bc99107fee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:09.795599 5052 tablet_bootstrap.cc:492] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:09.796120 5052 ts_tablet_manager.cc:1397] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.099s user 0.004s sys 0.008s
I20260807 13:32:09.798857 5052 raft_consensus.cc:348] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:09.799721 5052 raft_consensus.cc:374] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.802434 5055 tablet_bootstrap.cc:492] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:09.803361 5052 raft_consensus.cc:729] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.803668 5055 ts_tablet_manager.cc:1397] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.097s user 0.018s sys 0.013s
I20260807 13:32:09.804126 5052 consensus_queue.cc:260] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:09.806358 5033 heartbeater.cc:503] Master 127.3.187.254:41407 was elected leader, sending a full tablet report...
I20260807 13:32:09.806785 5052 ts_tablet_manager.cc:1428] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260807 13:32:09.806427 5055 raft_consensus.cc:348] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.807184 5055 raft_consensus.cc:374] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.807466 5055 raft_consensus.cc:729] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.807631 5052 tablet_bootstrap.cc:492] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:09.808190 5055 consensus_queue.cc:260] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.814612 5052 tablet_bootstrap.cc:654] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.796059 5050 tablet_bootstrap.cc:654] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.819484 4804 heartbeater.cc:503] Master 127.3.187.254:41407 was elected leader, sending a full tablet report...
I20260807 13:32:09.819942 5055 ts_tablet_manager.cc:1428] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.016s user 0.008s sys 0.007s
I20260807 13:32:09.820771 5055 tablet_bootstrap.cc:492] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:09.826514 5055 tablet_bootstrap.cc:654] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.831904 5050 tablet_bootstrap.cc:492] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:09.832401 5050 ts_tablet_manager.cc:1397] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.014s
I20260807 13:32:09.835237 5055 tablet_bootstrap.cc:492] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:09.835773 5055 ts_tablet_manager.cc:1397] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.002s
I20260807 13:32:09.835603 5050 raft_consensus.cc:348] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.836624 5050 raft_consensus.cc:374] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.836992 5050 raft_consensus.cc:729] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.838256 5052 tablet_bootstrap.cc:492] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:09.838033 5050 consensus_queue.cc:260] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.838769 5052 ts_tablet_manager.cc:1397] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.009s
W20260807 13:32:09.840726 4922 tablet.cc:2369] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:32:09.841478 5052 raft_consensus.cc:348] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.842015 5050 ts_tablet_manager.cc:1428] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 13:32:09.842434 5052 raft_consensus.cc:374] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.842779 5052 raft_consensus.cc:729] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.843111 5050 tablet_bootstrap.cc:492] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
I20260807 13:32:09.843283 5055 raft_consensus.cc:348] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:09.843636 5052 consensus_queue.cc:260] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.845780 5052 ts_tablet_manager.cc:1428] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.007s user 0.001s sys 0.004s
I20260807 13:32:09.846731 5052 tablet_bootstrap.cc:492] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:09.849800 5050 tablet_bootstrap.cc:654] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.844161 5055 raft_consensus.cc:374] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.852638 5052 tablet_bootstrap.cc:654] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.852967 5055 raft_consensus.cc:729] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.853931 5055 consensus_queue.cc:260] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:09.856277 5055 ts_tablet_manager.cc:1428] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260807 13:32:09.857153 5055 tablet_bootstrap.cc:492] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:09.857611 5050 tablet_bootstrap.cc:492] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:09.858306 5050 ts_tablet_manager.cc:1397] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.003s
I20260807 13:32:09.862985 5055 tablet_bootstrap.cc:654] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.864173 5052 tablet_bootstrap.cc:492] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:09.864672 5052 ts_tablet_manager.cc:1397] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.005s
I20260807 13:32:09.865629 5050 raft_consensus.cc:348] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.866415 5050 raft_consensus.cc:374] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.866743 5050 raft_consensus.cc:729] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.867830 5052 raft_consensus.cc:348] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.867992 5050 consensus_queue.cc:260] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.868624 5052 raft_consensus.cc:374] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.869001 5052 raft_consensus.cc:729] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.869762 5052 consensus_queue.cc:260] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.872264 5052 ts_tablet_manager.cc:1428] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:32:09.873160 5052 tablet_bootstrap.cc:492] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:09.873538 5050 ts_tablet_manager.cc:1428] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260807 13:32:09.874471 5050 tablet_bootstrap.cc:492] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
I20260807 13:32:09.880409 5050 tablet_bootstrap.cc:654] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.881935 5052 tablet_bootstrap.cc:654] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.880198 5055 tablet_bootstrap.cc:492] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:09.885589 5055 ts_tablet_manager.cc:1397] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.013s
I20260807 13:32:09.888557 5052 tablet_bootstrap.cc:492] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:09.888324 5055 raft_consensus.cc:348] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.888932 5052 ts_tablet_manager.cc:1397] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.000s
I20260807 13:32:09.888993 5050 tablet_bootstrap.cc:492] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:09.889120 5055 raft_consensus.cc:374] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.889550 5050 ts_tablet_manager.cc:1397] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.005s
I20260807 13:32:09.889500 5055 raft_consensus.cc:729] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.890352 5055 consensus_queue.cc:260] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.891229 5052 raft_consensus.cc:348] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.892012 5052 raft_consensus.cc:374] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.892336 5052 raft_consensus.cc:729] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.892479 5055 ts_tablet_manager.cc:1428] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 13:32:09.892123 5050 raft_consensus.cc:348] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.892958 5050 raft_consensus.cc:374] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.893272 5050 raft_consensus.cc:729] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.893205 5052 consensus_queue.cc:260] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.894070 5050 consensus_queue.cc:260] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.895527 5052 ts_tablet_manager.cc:1428] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 13:32:09.893474 5055 tablet_bootstrap.cc:492] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:09.896435 5052 tablet_bootstrap.cc:492] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:09.898094 5050 ts_tablet_manager.cc:1428] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.008s user 0.000s sys 0.007s
I20260807 13:32:09.899091 5050 tablet_bootstrap.cc:492] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
I20260807 13:32:09.904429 5052 tablet_bootstrap.cc:654] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.904820 5050 tablet_bootstrap.cc:654] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.906659 5055 tablet_bootstrap.cc:654] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.916540 5050 tablet_bootstrap.cc:492] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:09.916921 5050 ts_tablet_manager.cc:1397] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20260807 13:32:09.917080 5052 tablet_bootstrap.cc:492] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:09.917537 5052 ts_tablet_manager.cc:1397] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.009s
I20260807 13:32:09.918195 5055 tablet_bootstrap.cc:492] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:09.918615 5055 ts_tablet_manager.cc:1397] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.007s
I20260807 13:32:09.919104 5050 raft_consensus.cc:348] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.919631 5050 raft_consensus.cc:374] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.919898 5050 raft_consensus.cc:729] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.919979 5052 raft_consensus.cc:348] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.920713 5052 raft_consensus.cc:374] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.920503 5050 consensus_queue.cc:260] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.921010 5052 raft_consensus.cc:729] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.921036 5055 raft_consensus.cc:348] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.921831 5055 raft_consensus.cc:374] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.922267 5055 raft_consensus.cc:729] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.921854 5052 consensus_queue.cc:260] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.922576 5050 ts_tablet_manager.cc:1428] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260807 13:32:09.923045 5055 consensus_queue.cc:260] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.923547 5050 tablet_bootstrap.cc:492] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
I20260807 13:32:09.924386 5052 ts_tablet_manager.cc:1428] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 13:32:09.925040 5056 raft_consensus.cc:482] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:09.925487 5056 raft_consensus.cc:504] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.926591 5055 ts_tablet_manager.cc:1428] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260807 13:32:09.927281 5055 tablet_bootstrap.cc:492] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:09.929836 5050 tablet_bootstrap.cc:654] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.932055 5056 leader_election.cc:288] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:09.932190 5055 tablet_bootstrap.cc:654] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.935245 5052 tablet_bootstrap.cc:492] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:09.941306 5052 tablet_bootstrap.cc:654] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.954210 5060 raft_consensus.cc:482] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:09.954677 5060 raft_consensus.cc:504] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.963917 5050 tablet_bootstrap.cc:492] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:09.964388 5050 ts_tablet_manager.cc:1397] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.041s user 0.013s sys 0.016s
I20260807 13:32:09.965941 5060 leader_election.cc:288] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:09.967092 5050 raft_consensus.cc:348] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.967885 5050 raft_consensus.cc:374] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.968161 5050 raft_consensus.cc:729] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.968870 5050 consensus_queue.cc:260] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.971614 5050 ts_tablet_manager.cc:1428] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260807 13:32:09.971345 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:09.972754 5050 tablet_bootstrap.cc:492] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
W20260807 13:32:09.974259 4824 leader_election.cc:341] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:09.976117 5055 tablet_bootstrap.cc:492] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:09.976675 5055 ts_tablet_manager.cc:1397] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.049s user 0.009s sys 0.012s
I20260807 13:32:09.978900 5050 tablet_bootstrap.cc:654] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.979995 5055 raft_consensus.cc:348] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.980886 5055 raft_consensus.cc:374] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.981163 5055 raft_consensus.cc:729] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.981837 5055 consensus_queue.cc:260] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.985173 5061 raft_consensus.cc:482] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:09.985616 5061 raft_consensus.cc:504] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.987617 5052 tablet_bootstrap.cc:492] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:09.988162 5052 ts_tablet_manager.cc:1397] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.007s
I20260807 13:32:09.989089 5061 leader_election.cc:288] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:09.990583 5050 tablet_bootstrap.cc:492] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:09.991060 5050 ts_tablet_manager.cc:1397] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.004s
I20260807 13:32:09.990861 5052 raft_consensus.cc:348] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.991581 5052 raft_consensus.cc:374] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.991907 5052 raft_consensus.cc:729] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
I20260807 13:32:09.992772 5052 consensus_queue.cc:260] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.993798 5060 raft_consensus.cc:482] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:09.993883 5050 raft_consensus.cc:348] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:09.994369 5060 raft_consensus.cc:504] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:09.994777 5050 raft_consensus.cc:374] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:09.997135 5060 leader_election.cc:288] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), c8c665d676074226af419c349506f887 (127.3.187.193:43021)
I20260807 13:32:09.999416 5055 ts_tablet_manager.cc:1428] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260807 13:32:09.999578 5052 ts_tablet_manager.cc:1428] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20260807 13:32:10.000416 5055 tablet_bootstrap.cc:492] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:10.002421 5052 tablet_bootstrap.cc:492] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:10.004735 5060 raft_consensus.cc:482] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.005187 5060 raft_consensus.cc:504] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.007649 5060 leader_election.cc:288] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:10.012598 5052 tablet_bootstrap.cc:654] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:09.995224 5050 raft_consensus.cc:729] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.013827 5050 consensus_queue.cc:260] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.017076 5055 tablet_bootstrap.cc:654] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.018621 5050 ts_tablet_manager.cc:1428] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.027s user 0.006s sys 0.001s
I20260807 13:32:10.021914 5050 tablet_bootstrap.cc:492] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
I20260807 13:32:10.029601 5056 raft_consensus.cc:482] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.029942 5055 tablet_bootstrap.cc:492] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:10.031339 5055 ts_tablet_manager.cc:1397] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.010s
I20260807 13:32:10.030030 5056 raft_consensus.cc:504] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.040622 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.041018 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.041268 4763 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 0.
I20260807 13:32:10.041617 4764 raft_consensus.cc:2454] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 0.
I20260807 13:32:10.041409 5055 raft_consensus.cc:348] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.042182 5055 raft_consensus.cc:374] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.042517 5055 raft_consensus.cc:729] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.042764 5056 leader_election.cc:288] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.042701 4762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.042598 4939 leader_election.cc:302] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.044752 4939 leader_election.cc:302] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.045012 4762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146ee52a9e2f4d8b8146f273bfe20c2e" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.045650 4762 raft_consensus.cc:2454] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 0.
I20260807 13:32:10.045969 5052 tablet_bootstrap.cc:492] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:10.045697 5060 raft_consensus.cc:2781] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.046445 5060 raft_consensus.cc:482] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.046501 5052 ts_tablet_manager.cc:1397] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.044s user 0.016s sys 0.008s
I20260807 13:32:10.046859 5060 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.043287 5055 consensus_queue.cc:260] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.049396 5050 tablet_bootstrap.cc:654] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.050876 4824 leader_election.cc:302] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.051764 5055 ts_tablet_manager.cc:1428] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260807 13:32:10.051719 5056 raft_consensus.cc:2781] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.052184 5056 raft_consensus.cc:482] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.052497 5056 raft_consensus.cc:3037] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.052735 5055 tablet_bootstrap.cc:492] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:10.054317 5052 raft_consensus.cc:348] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.055325 5052 raft_consensus.cc:374] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.055688 5052 raft_consensus.cc:729] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
W20260807 13:32:10.058249 4939 leader_election.cc:341] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:10.060019 5106 raft_consensus.cc:2781] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.060834 5106 raft_consensus.cc:482] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.061272 5106 raft_consensus.cc:3037] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.056499 5052 consensus_queue.cc:260] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.067842 4886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503" is_pre_election: true
I20260807 13:32:10.068168 4885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503" is_pre_election: true
I20260807 13:32:10.068481 4886 raft_consensus.cc:2454] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 0.
I20260807 13:32:10.068846 4885 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 0.
I20260807 13:32:10.069646 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503" is_pre_election: true
I20260807 13:32:10.072948 4884 raft_consensus.cc:2454] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 0.
I20260807 13:32:10.074751 5060 raft_consensus.cc:504] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:10.077441 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16" is_pre_election: true
I20260807 13:32:10.077584 5056 raft_consensus.cc:504] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.078147 4992 raft_consensus.cc:2454] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 0.
W20260807 13:32:10.082716 4687 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:10.085767 5108 raft_consensus.cc:482] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.086282 4834 leader_election.cc:302] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters: c8c665d676074226af419c349506f887
I20260807 13:32:10.086426 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:10.086930 4941 leader_election.cc:302] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters: c8c665d676074226af419c349506f887
I20260807 13:32:10.087339 4884 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.092585 5111 raft_consensus.cc:482] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.092864 5055 tablet_bootstrap.cc:654] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.093066 5111 raft_consensus.cc:504] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.096154 4762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:10.096899 4762 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.094826 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146ee52a9e2f4d8b8146f273bfe20c2e" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16" is_pre_election: true
I20260807 13:32:10.101140 4992 raft_consensus.cc:2454] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 0.
I20260807 13:32:10.100947 5106 raft_consensus.cc:504] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.102308 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16" is_pre_election: true
I20260807 13:32:10.103893 5106 leader_election.cc:288] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
W20260807 13:32:10.104202 4713 leader_election.cc:341] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:10.105232 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:10.105962 4764 raft_consensus.cc:3037] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.088129 5060 leader_election.cc:288] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), c8c665d676074226af419c349506f887 (127.3.187.193:43021)
I20260807 13:32:10.106608 5109 raft_consensus.cc:2781] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.111972 5111 leader_election.cc:288] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.112495 5111 raft_consensus.cc:2781] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.112812 5111 raft_consensus.cc:482] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.113113 5111 raft_consensus.cc:3037] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.114400 4762 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 1.
I20260807 13:32:10.116340 4762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146ee52a9e2f4d8b8146f273bfe20c2e" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:10.116631 4885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503" is_pre_election: true
I20260807 13:32:10.117182 4762 raft_consensus.cc:3037] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.117467 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.117708 4939 leader_election.cc:302] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.118151 4763 raft_consensus.cc:2454] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 0.
W20260807 13:32:10.119028 4712 leader_election.cc:341] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:10.119586 4712 leader_election.cc:302] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c665d676074226af419c349506f887; no voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503
I20260807 13:32:10.119777 4824 leader_election.cc:302] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.121016 5061 raft_consensus.cc:2726] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:10.121997 5060 raft_consensus.cc:2781] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.122571 4884 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 1.
I20260807 13:32:10.122702 5060 raft_consensus.cc:686] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:10.124092 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16" is_pre_election: true
I20260807 13:32:10.106995 5108 raft_consensus.cc:504] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.124732 4992 raft_consensus.cc:2454] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 0.
I20260807 13:32:10.124130 5109 raft_consensus.cc:482] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.130280 5109 raft_consensus.cc:3037] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.127661 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.130843 5052 ts_tablet_manager.cc:1428] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.084s user 0.010s sys 0.006s
W20260807 13:32:10.131560 4939 leader_election.cc:341] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:10.131753 5052 tablet_bootstrap.cc:492] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:10.128787 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146ee52a9e2f4d8b8146f273bfe20c2e" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:10.132329 4992 raft_consensus.cc:3037] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.126940 5108 leader_election.cc:288] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:10.129558 4764 raft_consensus.cc:2454] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 1.
I20260807 13:32:10.124092 5056 leader_election.cc:288] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.129047 5111 raft_consensus.cc:504] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.133457 4762 raft_consensus.cc:2454] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 1.
I20260807 13:32:10.133945 5110 raft_consensus.cc:2781] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.124884 5060 consensus_queue.cc:237] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
W20260807 13:32:10.134030 4941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:35587, user_credentials={real_user=slave}} blocked reactor thread for 47300.3us
I20260807 13:32:10.136358 5110 raft_consensus.cc:482] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.137301 4939 leader_election.cc:302] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.137549 4824 leader_election.cc:302] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.138873 5110 raft_consensus.cc:3037] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.144728 5056 raft_consensus.cc:2781] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.146284 5108 raft_consensus.cc:2781] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.147970 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:10.161098 5108 raft_consensus.cc:686] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:10.148957 4885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503" is_pre_election: true
I20260807 13:32:10.153766 5050 tablet_bootstrap.cc:492] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:10.161494 4884 raft_consensus.cc:3037] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.149842 4991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:10.164994 4991 raft_consensus.cc:3037] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.165635 4992 raft_consensus.cc:2454] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 1.
I20260807 13:32:10.148545 5111 leader_election.cc:288] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.152956 5052 tablet_bootstrap.cc:654] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.166932 4885 raft_consensus.cc:2379] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599c0b06734d46dba4877a2de293bb16 in current term 1: Already voted for candidate a873f49ccdd84afd86937a5ff9a30503 in this term.
I20260807 13:32:10.160431 4623 catalog_manager.cc:5495] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:10.173064 4884 raft_consensus.cc:2454] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 1.
I20260807 13:32:10.170334 5108 consensus_queue.cc:237] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.160421 5060 raft_consensus.cc:482] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.176594 5055 tablet_bootstrap.cc:492] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:10.166254 5050 ts_tablet_manager.cc:1397] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.145s user 0.011s sys 0.006s
I20260807 13:32:10.177074 4941 leader_election.cc:302] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16; no voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887
I20260807 13:32:10.179096 5055 ts_tablet_manager.cc:1397] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.127s user 0.009s sys 0.005s
I20260807 13:32:10.178319 5060 raft_consensus.cc:504] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.177673 5056 raft_consensus.cc:686] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:10.179044 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
W20260807 13:32:10.182518 4824 leader_election.cc:341] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:10.183096 5060 leader_election.cc:288] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:10.184456 5055 raft_consensus.cc:348] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.184479 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca69c36b4e44b7bb5529010fcc63122" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.184906 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca69c36b4e44b7bb5529010fcc63122" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503" is_pre_election: true
I20260807 13:32:10.185201 5055 raft_consensus.cc:374] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.185765 4991 raft_consensus.cc:2454] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 1.
I20260807 13:32:10.185550 5050 raft_consensus.cc:348] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
W20260807 13:32:10.186236 4939 leader_election.cc:341] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:10.186306 5050 raft_consensus.cc:374] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.186331 5060 raft_consensus.cc:2726] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:10.186738 5050 raft_consensus.cc:729] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.186839 4834 leader_election.cc:302] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters: c8c665d676074226af419c349506f887
I20260807 13:32:10.185855 5055 raft_consensus.cc:729] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.187776 5118 raft_consensus.cc:2781] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.188369 5118 raft_consensus.cc:686] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:10.187850 5055 consensus_queue.cc:260] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.189894 5050 consensus_queue.cc:260] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.190985 4884 raft_consensus.cc:2454] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 0.
I20260807 13:32:10.189232 5118 consensus_queue.cc:237] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.184935 5056 consensus_queue.cc:237] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.200675 5055 ts_tablet_manager.cc:1428] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.019s user 0.003s sys 0.003s
I20260807 13:32:10.201663 5055 tablet_bootstrap.cc:492] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:10.202368 4941 leader_election.cc:302] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters: c8c665d676074226af419c349506f887
I20260807 13:32:10.203270 5060 raft_consensus.cc:2781] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.203727 5060 raft_consensus.cc:482] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.204121 5060 raft_consensus.cc:3037] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.207430 5055 tablet_bootstrap.cc:654] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.192415 5109 raft_consensus.cc:504] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.211503 5109 leader_election.cc:288] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:10.213227 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:10.213811 4764 raft_consensus.cc:3037] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.213583 5060 raft_consensus.cc:504] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.217072 4762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca69c36b4e44b7bb5529010fcc63122" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
W20260807 13:32:10.218797 4939 leader_election.cc:341] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:10.219609 5110 raft_consensus.cc:504] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.222661 4762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:10.223433 4762 raft_consensus.cc:3037] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.223747 5110 leader_election.cc:288] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.227165 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:10.227469 4991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:10.227891 4884 raft_consensus.cc:3037] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.228255 4991 raft_consensus.cc:3037] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.233599 4762 raft_consensus.cc:2454] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 1.
I20260807 13:32:10.234594 4824 leader_election.cc:302] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.235574 5118 raft_consensus.cc:482] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.235977 5118 raft_consensus.cc:504] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.237347 4764 raft_consensus.cc:2454] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 1.
I20260807 13:32:10.238481 4939 leader_election.cc:302] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.239750 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.240332 4763 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 0.
I20260807 13:32:10.241406 4824 leader_election.cc:302] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.242221 5111 raft_consensus.cc:2781] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.242686 5111 raft_consensus.cc:686] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:10.243243 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16" is_pre_election: true
I20260807 13:32:10.243474 5111 consensus_queue.cc:237] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
W20260807 13:32:10.244743 4834 leader_election.cc:341] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:10.245438 5108 raft_consensus.cc:2781] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.237847 5118 leader_election.cc:288] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.246246 5108 raft_consensus.cc:686] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:10.246697 5118 raft_consensus.cc:2781] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.247031 5118 raft_consensus.cc:482] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.247408 5118 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.247182 5108 consensus_queue.cc:237] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.250423 4991 raft_consensus.cc:2454] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 1.
I20260807 13:32:10.254257 5060 leader_election.cc:288] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:10.254249 4885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca69c36b4e44b7bb5529010fcc63122" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:10.257714 4885 raft_consensus.cc:3037] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.258752 4621 catalog_manager.cc:5495] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 0 to 1, leader changed from <none> to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:10.267074 5050 ts_tablet_manager.cc:1428] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.088s user 0.005s sys 0.010s
I20260807 13:32:10.268018 5050 tablet_bootstrap.cc:492] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
I20260807 13:32:10.268510 5055 tablet_bootstrap.cc:492] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:10.269009 5055 ts_tablet_manager.cc:1397] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.068s user 0.011s sys 0.002s
I20260807 13:32:10.272078 5055 raft_consensus.cc:348] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.273028 5055 raft_consensus.cc:374] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.273236 5050 tablet_bootstrap.cc:654] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.273449 5055 raft_consensus.cc:729] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.274479 5055 consensus_queue.cc:260] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.276283 4885 raft_consensus.cc:2454] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 1.
I20260807 13:32:10.277437 4941 leader_election.cc:302] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters: c8c665d676074226af419c349506f887
I20260807 13:32:10.278208 5108 raft_consensus.cc:2781] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.278662 5108 raft_consensus.cc:686] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:10.278846 5055 ts_tablet_manager.cc:1428] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260807 13:32:10.279654 5055 tablet_bootstrap.cc:492] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:10.279413 5108 consensus_queue.cc:237] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.280422 5052 tablet_bootstrap.cc:492] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:10.279624 5118 raft_consensus.cc:504] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.282689 5118 leader_election.cc:288] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.283078 5052 ts_tablet_manager.cc:1397] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.152s user 0.024s sys 0.031s
I20260807 13:32:10.283365 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:10.283644 4991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:10.283978 4764 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.284999 4884 raft_consensus.cc:2454] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 1.
W20260807 13:32:10.286273 4834 leader_election.cc:341] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:10.286801 5052 raft_consensus.cc:348] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.287433 5052 raft_consensus.cc:374] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.287689 5052 raft_consensus.cc:729] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.288264 5052 consensus_queue.cc:260] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.289131 5055 tablet_bootstrap.cc:654] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.290187 5052 ts_tablet_manager.cc:1428] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:32:10.290992 5052 tablet_bootstrap.cc:492] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:10.297734 5052 tablet_bootstrap.cc:654] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.299340 4764 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 1.
I20260807 13:32:10.300421 5050 tablet_bootstrap.cc:492] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:10.300494 4824 leader_election.cc:302] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters: 599c0b06734d46dba4877a2de293bb16
I20260807 13:32:10.301231 5050 ts_tablet_manager.cc:1397] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.002s
I20260807 13:32:10.301590 5118 raft_consensus.cc:2781] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.302042 5118 raft_consensus.cc:686] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:10.303541 5050 raft_consensus.cc:348] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.303236 5118 consensus_queue.cc:237] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.306303 5050 raft_consensus.cc:374] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.306751 5050 raft_consensus.cc:729] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.308907 5055 tablet_bootstrap.cc:492] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:10.309425 5055 ts_tablet_manager.cc:1397] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.007s
I20260807 13:32:10.309043 5050 consensus_queue.cc:260] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.311187 5050 ts_tablet_manager.cc:1428] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.010s user 0.001s sys 0.004s
I20260807 13:32:10.311707 5052 tablet_bootstrap.cc:492] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:10.312016 5050 tablet_bootstrap.cc:492] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503: Bootstrap starting.
I20260807 13:32:10.312135 5052 ts_tablet_manager.cc:1397] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.001s
I20260807 13:32:10.312188 5055 raft_consensus.cc:348] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.313162 5055 raft_consensus.cc:374] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.313511 5055 raft_consensus.cc:729] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.314320 5055 consensus_queue.cc:260] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.314406 5052 raft_consensus.cc:348] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.315248 5052 raft_consensus.cc:374] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.315529 5052 raft_consensus.cc:729] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.316164 5052 consensus_queue.cc:260] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.317598 5050 tablet_bootstrap.cc:654] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.318487 5052 ts_tablet_manager.cc:1428] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 13:32:10.319475 5052 tablet_bootstrap.cc:492] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16: Bootstrap starting.
I20260807 13:32:10.320549 5055 ts_tablet_manager.cc:1428] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260807 13:32:10.321413 5055 tablet_bootstrap.cc:492] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887: Bootstrap starting.
I20260807 13:32:10.325871 5052 tablet_bootstrap.cc:654] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.326695 5055 tablet_bootstrap.cc:654] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:10.339445 5050 tablet_bootstrap.cc:492] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503: No bootstrap required, opened a new log
I20260807 13:32:10.339043 4623 catalog_manager.cc:5495] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:10.339911 5050 ts_tablet_manager.cc:1397] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.011s
I20260807 13:32:10.340534 5052 tablet_bootstrap.cc:492] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16: No bootstrap required, opened a new log
I20260807 13:32:10.342399 5052 ts_tablet_manager.cc:1397] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.013s
I20260807 13:32:10.343839 5050 raft_consensus.cc:348] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.344581 5050 raft_consensus.cc:374] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.344980 5050 raft_consensus.cc:729] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.346017 5050 consensus_queue.cc:260] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.346572 5055 tablet_bootstrap.cc:492] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887: No bootstrap required, opened a new log
I20260807 13:32:10.347025 5055 ts_tablet_manager.cc:1397] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.000s
I20260807 13:32:10.341969 4623 catalog_manager.cc:5495] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:10.346976 5052 raft_consensus.cc:348] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.344976 5118 raft_consensus.cc:482] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.348424 5118 raft_consensus.cc:504] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.347740 5052 raft_consensus.cc:374] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.348170 4623 catalog_manager.cc:5495] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:10.349188 5052 raft_consensus.cc:729] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.349449 5055 raft_consensus.cc:348] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.350170 5055 raft_consensus.cc:374] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:10.349872 5052 consensus_queue.cc:260] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.350430 5055 raft_consensus.cc:729] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Initialized, Role: FOLLOWER
I20260807 13:32:10.351040 5055 consensus_queue.cc:260] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.351408 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "038d9af0b5d6451fb19a7bc99107fee0" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.351872 5052 ts_tablet_manager.cc:1428] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16: Time spent starting tablet: real 0.009s user 0.003s sys 0.001s
I20260807 13:32:10.352010 4764 raft_consensus.cc:2454] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 0.
I20260807 13:32:10.352995 5118 leader_election.cc:288] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.353088 4824 leader_election.cc:302] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.353420 5055 ts_tablet_manager.cc:1428] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 13:32:10.354436 5121 raft_consensus.cc:2781] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.354569 4991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "038d9af0b5d6451fb19a7bc99107fee0" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16" is_pre_election: true
I20260807 13:32:10.354810 5121 raft_consensus.cc:482] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.355147 5121 raft_consensus.cc:3037] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.355312 5050 ts_tablet_manager.cc:1428] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503: Time spent starting tablet: real 0.014s user 0.001s sys 0.004s
I20260807 13:32:10.355173 4991 raft_consensus.cc:2454] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 0.
I20260807 13:32:10.360975 5121 raft_consensus.cc:504] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.362402 4621 catalog_manager.cc:5495] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 0 to 1, leader changed from <none> to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:10.363752 5121 leader_election.cc:288] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.364135 4621 catalog_manager.cc:5495] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 0 to 1, leader changed from <none> to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:10.364751 4991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "038d9af0b5d6451fb19a7bc99107fee0" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:10.365326 4991 raft_consensus.cc:3037] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.365401 4621 catalog_manager.cc:5495] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 0 to 1, leader changed from <none> to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:10.366844 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "038d9af0b5d6451fb19a7bc99107fee0" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:10.367408 4764 raft_consensus.cc:3037] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.370412 4991 raft_consensus.cc:2454] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 1.
I20260807 13:32:10.371518 4834 leader_election.cc:302] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters:
I20260807 13:32:10.372637 5121 raft_consensus.cc:2781] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.373116 5121 raft_consensus.cc:686] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:10.373944 5121 consensus_queue.cc:237] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.374744 4764 raft_consensus.cc:2454] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 1.
I20260807 13:32:10.386483 4621 catalog_manager.cc:5495] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 0 to 1, leader changed from <none> to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:10.396819 5108 raft_consensus.cc:482] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.397177 5108 raft_consensus.cc:504] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.398725 5108 leader_election.cc:288] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:10.399331 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.399636 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503" is_pre_election: true
I20260807 13:32:10.399948 4764 raft_consensus.cc:2379] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599c0b06734d46dba4877a2de293bb16 in current term 1: Already voted for candidate a873f49ccdd84afd86937a5ff9a30503 in this term.
I20260807 13:32:10.400894 4939 leader_election.cc:302] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16; no voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887
I20260807 13:32:10.401543 5108 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.405850 5108 raft_consensus.cc:2726] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:10.603696 5108 consensus_queue.cc:1035] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.616803 5109 consensus_queue.cc:1035] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.617607 5060 raft_consensus.cc:482] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.618076 5060 raft_consensus.cc:504] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.619102 5061 raft_consensus.cc:482] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:10.619536 5061 raft_consensus.cc:504] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.620047 5060 leader_election.cc:288] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:10.621402 5061 leader_election.cc:288] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.621829 4885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503" is_pre_election: true
I20260807 13:32:10.622481 4885 raft_consensus.cc:2454] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 0.
I20260807 13:32:10.622854 4886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503" is_pre_election: true
I20260807 13:32:10.624260 4991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "599c0b06734d46dba4877a2de293bb16" is_pre_election: true
I20260807 13:32:10.624785 4941 leader_election.cc:302] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters:
I20260807 13:32:10.625070 4991 raft_consensus.cc:2379] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8c665d676074226af419c349506f887 in current term 1: Already voted for candidate a873f49ccdd84afd86937a5ff9a30503 in this term.
I20260807 13:32:10.625801 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887" is_pre_election: true
I20260807 13:32:10.626458 4764 raft_consensus.cc:2454] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 0.
I20260807 13:32:10.627110 5060 raft_consensus.cc:2781] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:10.627008 4713 leader_election.cc:302] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8c665d676074226af419c349506f887; no voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503
I20260807 13:32:10.627460 5060 raft_consensus.cc:482] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:10.627787 5060 raft_consensus.cc:3037] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.629024 5061 raft_consensus.cc:3037] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.634514 5060 raft_consensus.cc:504] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.636529 5061 raft_consensus.cc:2726] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:10.637270 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:10.636350 5121 consensus_queue.cc:1035] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.637827 4764 raft_consensus.cc:3037] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.638092 5060 leader_election.cc:288] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:10.640743 5121 consensus_queue.cc:1035] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.644237 4764 raft_consensus.cc:2454] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 1.
I20260807 13:32:10.645177 4939 leader_election.cc:302] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.645910 5060 raft_consensus.cc:2781] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:10.646417 5060 raft_consensus.cc:686] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:10.647433 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:10.647321 5060 consensus_queue.cc:237] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.647975 4884 raft_consensus.cc:3037] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.653672 5109 consensus_queue.cc:1035] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:10.655107 4884 raft_consensus.cc:2454] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 1.
I20260807 13:32:10.664640 5111 consensus_queue.cc:1035] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:10.675123 5118 consensus_queue.cc:1035] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.676608 4621 catalog_manager.cc:5495] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:10.682853 5108 consensus_queue.cc:1035] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:10.689996 5110 consensus_queue.cc:1035] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.705592 5108 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:10.723690 5111 consensus_queue.cc:1035] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.725250 4763 raft_consensus.cc:3037] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:10.733297 5060 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.734045 5113 consensus_queue.cc:1035] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.749631 5109 consensus_queue.cc:1035] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.774067 4992 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39420
I20260807 13:32:10.774749 4992 raft_consensus.cc:595] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:10.788097 4884 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "146ee52a9e2f4d8b8146f273bfe20c2e"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39714
I20260807 13:32:10.788595 4884 raft_consensus.cc:595] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:10.793174 4992 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39420
I20260807 13:32:10.793637 4992 raft_consensus.cc:595] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:10.798019 4884 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39714
I20260807 13:32:10.798557 4884 raft_consensus.cc:595] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:10.803260 4884 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39714
I20260807 13:32:10.803647 4884 raft_consensus.cc:595] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:10.807695 4992 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
mode: GRACEFUL
new_leader_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:39420
I20260807 13:32:10.808090 4992 raft_consensus.cc:595] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Received request to transfer leadership to TS a873f49ccdd84afd86937a5ff9a30503
I20260807 13:32:10.812310 4992 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
mode: GRACEFUL
new_leader_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:39420
I20260807 13:32:10.812708 4992 raft_consensus.cc:595] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Received request to transfer leadership to TS a873f49ccdd84afd86937a5ff9a30503
I20260807 13:32:10.818902 4992 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3ca69c36b4e44b7bb5529010fcc63122"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
mode: GRACEFUL
new_leader_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:39420
I20260807 13:32:10.819289 4992 raft_consensus.cc:595] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Received request to transfer leadership to TS a873f49ccdd84afd86937a5ff9a30503
I20260807 13:32:10.823242 4884 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "038d9af0b5d6451fb19a7bc99107fee0"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
mode: GRACEFUL
new_leader_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:39714
I20260807 13:32:10.823635 4884 raft_consensus.cc:595] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Received request to transfer leadership to TS 599c0b06734d46dba4877a2de293bb16
I20260807 13:32:10.836205 5111 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.845863 5111 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.852501 5111 raft_consensus.cc:979] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:10.852888 5118 raft_consensus.cc:1067] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:10.854367 4763 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55084
I20260807 13:32:10.855216 4763 raft_consensus.cc:482] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:10.855583 4763 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:10.861253 4763 raft_consensus.cc:504] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.863024 4763 leader_election.cc:288] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:10.863813 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:10.864053 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:10.864533 4884 raft_consensus.cc:3032] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:10.864619 4992 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:10.864948 4884 raft_consensus.cc:729] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:10.865684 4884 consensus_queue.cc:260] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.866660 4884 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:10.870093 4992 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:10.871299 4713 leader_election.cc:302] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.871809 4884 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:10.872084 5061 raft_consensus.cc:2781] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:10.873337 5061 raft_consensus.cc:686] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:10.873955 5118 consensus_queue.cc:1035] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.874184 5061 consensus_queue.cc:237] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.881239 4621 catalog_manager.cc:5495] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 reported cstate change: term changed from 1 to 2, leader changed from a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 2 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:10.884184 5056 consensus_queue.cc:1035] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:10.892228 5056 raft_consensus.cc:979] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503: : Instructing follower 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:10.892668 5118 raft_consensus.cc:1067] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Signalling peer 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:10.894002 4992 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "038d9af0b5d6451fb19a7bc99107fee0"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:39410
I20260807 13:32:10.894553 4992 raft_consensus.cc:482] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:10.894912 4992 raft_consensus.cc:3037] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:10.900144 4992 raft_consensus.cc:504] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.901676 4992 leader_election.cc:288] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 2 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:10.902499 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "038d9af0b5d6451fb19a7bc99107fee0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:10.902794 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "038d9af0b5d6451fb19a7bc99107fee0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:10.903115 4763 raft_consensus.cc:3037] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:10.903411 4884 raft_consensus.cc:3032] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:10.903720 4884 raft_consensus.cc:729] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:10.904374 4884 consensus_queue.cc:260] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.905267 4884 raft_consensus.cc:3037] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:10.908344 4763 raft_consensus.cc:2454] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 2.
I20260807 13:32:10.909245 4939 leader_election.cc:302] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:10.910004 5109 raft_consensus.cc:2781] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:10.910236 4884 raft_consensus.cc:2454] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 2.
I20260807 13:32:10.910498 5109 raft_consensus.cc:686] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 2 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:10.911315 5109 consensus_queue.cc:237] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:10.916832 4623 catalog_manager.cc:5495] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 1 to 2, leader changed from a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194) to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 2 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:11.043143 5109 consensus_queue.cc:1035] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:11.053308 5060 consensus_queue.cc:1035] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:11.062196 5108 raft_consensus.cc:979] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16: : Instructing follower a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:11.062655 5060 raft_consensus.cc:1067] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Signalling peer a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:11.064116 4884 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:39692
I20260807 13:32:11.064654 4884 raft_consensus.cc:482] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:11.065009 4884 raft_consensus.cc:3037] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.069373 4884 raft_consensus.cc:504] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.071210 4884 leader_election.cc:288] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 2 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:11.071918 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:11.072229 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:11.072476 4763 raft_consensus.cc:3037] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.072883 4992 raft_consensus.cc:3032] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:11.073246 4992 raft_consensus.cc:729] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:11.074041 4992 consensus_queue.cc:260] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.075151 4992 raft_consensus.cc:3037] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.078682 4763 raft_consensus.cc:2454] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 2.
I20260807 13:32:11.079644 4824 leader_election.cc:302] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:11.080338 5110 raft_consensus.cc:2781] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:11.080701 4992 raft_consensus.cc:2454] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 2.
I20260807 13:32:11.080852 5110 raft_consensus.cc:686] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:11.081678 5110 consensus_queue.cc:237] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.088209 4621 catalog_manager.cc:5495] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 1 to 2, leader changed from 599c0b06734d46dba4877a2de293bb16 (127.3.187.195) to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:11.118440 5110 raft_consensus.cc:979] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:11.118911 5118 raft_consensus.cc:1067] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:11.120332 4763 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55084
I20260807 13:32:11.120818 4763 raft_consensus.cc:482] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:11.121198 4763 raft_consensus.cc:3037] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.125823 4763 raft_consensus.cc:504] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.127395 4763 leader_election.cc:288] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:11.128130 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:11.128427 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:11.128767 4884 raft_consensus.cc:3032] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:11.128963 4992 raft_consensus.cc:3037] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.129105 4884 raft_consensus.cc:729] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:11.129886 4884 consensus_queue.cc:260] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.130860 4884 raft_consensus.cc:3037] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.133746 4992 raft_consensus.cc:2454] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:11.134692 4713 leader_election.cc:302] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:11.135367 4884 raft_consensus.cc:2454] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:11.135488 5061 raft_consensus.cc:2781] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:11.136023 5061 raft_consensus.cc:686] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:11.136756 5061 consensus_queue.cc:237] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.145205 4621 catalog_manager.cc:5495] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 reported cstate change: term changed from 1 to 2, leader changed from a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 2 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:11.201584 5108 raft_consensus.cc:979] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:11.202014 5060 raft_consensus.cc:1067] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:11.203310 4763 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55092
I20260807 13:32:11.203913 4763 raft_consensus.cc:482] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:11.204245 4763 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.208627 4763 raft_consensus.cc:504] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:11.210026 4763 leader_election.cc:288] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Requested vote from peers 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:11.210824 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:11.211050 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:11.211418 4992 raft_consensus.cc:3032] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:11.211653 4884 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.211782 4992 raft_consensus.cc:729] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:11.212548 4992 consensus_queue.cc:260] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:11.213563 4992 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.216758 5108 raft_consensus.cc:979] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:11.217190 5108 raft_consensus.cc:1067] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:11.217247 4884 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:11.218297 4712 leader_election.cc:302] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:11.218675 4763 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55092
I20260807 13:32:11.219125 5061 raft_consensus.cc:2781] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:11.219276 4763 raft_consensus.cc:482] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:11.219597 5061 raft_consensus.cc:686] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:11.219651 4763 raft_consensus.cc:3037] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.219856 4992 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:11.220518 5061 consensus_queue.cc:237] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:11.225857 4763 raft_consensus.cc:504] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.227639 4763 leader_election.cc:288] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:11.228485 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:11.229041 4884 raft_consensus.cc:3037] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.228731 4621 catalog_manager.cc:5495] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 reported cstate change: term changed from 1 to 2, leader changed from 599c0b06734d46dba4877a2de293bb16 (127.3.187.195) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 2 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:11.229319 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:11.229888 4992 raft_consensus.cc:3032] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:11.230245 4992 raft_consensus.cc:729] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:11.230986 4992 consensus_queue.cc:260] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.232190 4992 raft_consensus.cc:3037] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.235028 4884 raft_consensus.cc:2454] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:11.236145 4712 leader_election.cc:302] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:11.237042 5061 raft_consensus.cc:2781] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:11.237509 5061 raft_consensus.cc:686] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:11.238101 4992 raft_consensus.cc:2454] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:11.238345 5061 consensus_queue.cc:237] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.243551 5108 raft_consensus.cc:979] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16: : Instructing follower a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:11.244091 5109 raft_consensus.cc:1067] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Signalling peer a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:11.245955 4884 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:39692
I20260807 13:32:11.245386 4621 catalog_manager.cc:5495] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 reported cstate change: term changed from 1 to 2, leader changed from 599c0b06734d46dba4877a2de293bb16 (127.3.187.195) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 2 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:11.246483 4884 raft_consensus.cc:482] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:11.246869 4884 raft_consensus.cc:3037] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.251088 4884 raft_consensus.cc:504] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.252966 4884 leader_election.cc:288] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 2 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:11.253726 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:11.254020 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:11.254317 4763 raft_consensus.cc:3037] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.254570 4992 raft_consensus.cc:3032] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:11.254935 4992 raft_consensus.cc:729] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:11.255749 4992 consensus_queue.cc:260] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.256918 4992 raft_consensus.cc:3037] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.258356 5056 raft_consensus.cc:979] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:11.258810 5056 raft_consensus.cc:1067] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:11.260104 4763 raft_consensus.cc:2454] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 2.
I20260807 13:32:11.261346 4824 leader_election.cc:302] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:11.262092 5056 raft_consensus.cc:2781] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:11.262494 4763 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "146ee52a9e2f4d8b8146f273bfe20c2e"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55084
I20260807 13:32:11.262607 5056 raft_consensus.cc:686] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:11.263198 4763 raft_consensus.cc:482] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:11.263661 4763 raft_consensus.cc:3037] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.263624 5056 consensus_queue.cc:237] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.263653 4992 raft_consensus.cc:2454] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 2.
I20260807 13:32:11.268419 4763 raft_consensus.cc:504] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.270361 4763 leader_election.cc:288] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:11.270453 4621 catalog_manager.cc:5495] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 1 to 2, leader changed from 599c0b06734d46dba4877a2de293bb16 (127.3.187.195) to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:11.273309 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146ee52a9e2f4d8b8146f273bfe20c2e" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:11.273818 4992 raft_consensus.cc:3037] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.273840 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "146ee52a9e2f4d8b8146f273bfe20c2e" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:11.274564 4884 raft_consensus.cc:3032] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:11.274880 4884 raft_consensus.cc:729] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:11.275629 4884 consensus_queue.cc:260] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.276813 4884 raft_consensus.cc:3037] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.280012 4992 raft_consensus.cc:2454] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:11.280975 4713 leader_election.cc:302] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:11.281742 5061 raft_consensus.cc:2781] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:11.282184 5061 raft_consensus.cc:686] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:11.282840 4884 raft_consensus.cc:2454] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:11.282995 5061 consensus_queue.cc:237] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.286672 5060 raft_consensus.cc:979] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16: : Instructing follower a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:11.287083 5060 raft_consensus.cc:1067] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Signalling peer a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:11.288760 4884 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3ca69c36b4e44b7bb5529010fcc63122"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:39692
I20260807 13:32:11.289248 4884 raft_consensus.cc:482] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:11.289531 4884 raft_consensus.cc:3037] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.291651 4623 catalog_manager.cc:5495] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 reported cstate change: term changed from 1 to 2, leader changed from a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 2 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:11.294947 4884 raft_consensus.cc:504] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.297190 4884 leader_election.cc:288] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 2 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:11.297108 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca69c36b4e44b7bb5529010fcc63122" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:11.297411 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ca69c36b4e44b7bb5529010fcc63122" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:11.297748 4763 raft_consensus.cc:3037] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.297968 4992 raft_consensus.cc:3032] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:11.298331 4992 raft_consensus.cc:729] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:11.299047 4992 consensus_queue.cc:260] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.300191 4992 raft_consensus.cc:3037] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:11.302284 4763 raft_consensus.cc:2454] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 2.
I20260807 13:32:11.303107 4824 leader_election.cc:302] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:11.303755 5056 raft_consensus.cc:2781] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:11.304107 5056 raft_consensus.cc:686] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:11.304592 4992 raft_consensus.cc:2454] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 2.
I20260807 13:32:11.304808 5056 consensus_queue.cc:237] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:11.310266 4623 catalog_manager.cc:5495] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 1 to 2, leader changed from 599c0b06734d46dba4877a2de293bb16 (127.3.187.195) to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:11.380196 4992 raft_consensus.cc:1261] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.381278 5061 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.388542 4884 raft_consensus.cc:1261] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.390587 5061 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.485477 4884 raft_consensus.cc:1261] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.486667 5108 consensus_queue.cc:1035] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.492000 4763 raft_consensus.cc:1261] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.493429 5113 consensus_queue.cc:1035] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.501694 4763 raft_consensus.cc:1261] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.502950 5056 consensus_queue.cc:1035] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.509801 4992 raft_consensus.cc:1261] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.511161 5110 consensus_queue.cc:1035] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.531117 4992 raft_consensus.cc:1261] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.532166 5061 consensus_queue.cc:1035] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.539003 4884 raft_consensus.cc:1261] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.540524 5184 consensus_queue.cc:1035] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.638170 4884 raft_consensus.cc:1261] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.639851 4886 raft_consensus.cc:1261] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.640561 5184 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:32:11.641857 4992 raft_consensus.cc:1261] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.641741 5191 consensus_queue.cc:1035] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:32:11.644635 5191 consensus_queue.cc:1035] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:32:11.681231 4992 raft_consensus.cc:1261] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.683109 5191 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.743809 4992 raft_consensus.cc:1261] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.745085 5110 consensus_queue.cc:1035] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.754364 4763 raft_consensus.cc:1261] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.755978 5192 consensus_queue.cc:1035] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.808410 4992 raft_consensus.cc:1261] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.809650 5192 consensus_queue.cc:1035] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.811738 4884 raft_consensus.cc:1261] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.812966 5196 consensus_queue.cc:1035] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.821081 4763 raft_consensus.cc:1261] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.823982 4992 raft_consensus.cc:1261] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:11.825206 5056 consensus_queue.cc:1035] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:11.826082 5195 consensus_queue.cc:1035] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:13.851681 3823 auto_leader_rebalancer-test.cc:339] The leader distribution is
I20260807 13:32:13.852281 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:13.870685 4763 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7"
dest_uuid: "c8c665d676074226af419c349506f887"
mode: GRACEFUL
new_leader_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:55100
I20260807 13:32:13.871193 4763 raft_consensus.cc:595] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Received request to transfer leadership to TS 599c0b06734d46dba4877a2de293bb16
I20260807 13:32:13.873240 4763 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0"
dest_uuid: "c8c665d676074226af419c349506f887"
mode: GRACEFUL
new_leader_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:55100
I20260807 13:32:13.873634 4763 raft_consensus.cc:595] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Received request to transfer leadership to TS 599c0b06734d46dba4877a2de293bb16
I20260807 13:32:13.874492 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 13:32:13.874869 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:13.998945 5211 raft_consensus.cc:979] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887: : Instructing follower 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:13.999424 5196 raft_consensus.cc:1067] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Signalling peer 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:14.000686 4992 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:39418
I20260807 13:32:14.001129 4992 raft_consensus.cc:482] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:14.001420 4992 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:14.005234 4992 raft_consensus.cc:504] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:14.006464 4992 leader_election.cc:288] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 3 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:14.007331 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:14.007555 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:14.007925 4763 raft_consensus.cc:3032] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:32:14.008034 4884 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:14.008247 4763 raft_consensus.cc:729] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:14.008980 4763 consensus_queue.cc:260] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:14.010159 4763 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:14.013707 4884 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 3.
I20260807 13:32:14.014766 4941 leader_election.cc:302] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters:
I20260807 13:32:14.015463 5207 raft_consensus.cc:2781] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:32:14.015548 4763 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 3.
I20260807 13:32:14.016572 5207 raft_consensus.cc:686] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:14.017335 5207 consensus_queue.cc:237] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:14.023823 4621 catalog_manager.cc:5495] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 2 to 3, leader changed from c8c665d676074226af419c349506f887 (127.3.187.193) to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:14.343365 5211 raft_consensus.cc:979] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887: : Instructing follower 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:14.343792 5196 raft_consensus.cc:1067] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Signalling peer 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:14.345117 4992 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:39418
I20260807 13:32:14.345526 4992 raft_consensus.cc:482] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:14.345777 4992 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:14.349720 4992 raft_consensus.cc:504] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:14.350960 4992 leader_election.cc:288] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 3 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), c8c665d676074226af419c349506f887 (127.3.187.193:43021)
I20260807 13:32:14.351655 4884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:14.351922 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:14.352195 4884 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:14.352380 4763 raft_consensus.cc:3032] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:32:14.352694 4763 raft_consensus.cc:729] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:14.353350 4763 consensus_queue.cc:260] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:14.354463 4763 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:14.357905 4884 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 3.
I20260807 13:32:14.358918 4941 leader_election.cc:302] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters:
I20260807 13:32:14.359643 5207 raft_consensus.cc:2781] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:32:14.360014 5207 raft_consensus.cc:686] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:14.360322 4763 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 3.
I20260807 13:32:14.360750 5207 consensus_queue.cc:237] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:14.368079 4621 catalog_manager.cc:5495] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 2 to 3, leader changed from c8c665d676074226af419c349506f887 (127.3.187.193) to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:14.439455 4884 raft_consensus.cc:1261] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:14.440632 5207 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:14.450711 4763 raft_consensus.cc:1261] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:14.452348 5224 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:14.791203 4884 raft_consensus.cc:1261] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:14.792716 5207 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:14.806686 4763 raft_consensus.cc:1261] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:14.808034 5207 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:14.875883 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:14.883682 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:14.884122 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:15.884863 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:15.889837 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:15.890205 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:16.891026 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:16.896065 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:16.896502 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:17.897270 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:17.902737 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:17.903146 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:18.903918 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:18.908927 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:18.909322 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:19.910188 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:19.916124 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:19.916631 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:20.917382 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:20.922240 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:20.922547 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:21.923277 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:21.928118 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:21.928435 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:22.929247 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:22.934268 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:22.934580 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:23.963234 3823 auto_leader_rebalancer-test.cc:358] The leader distribution is
I20260807 13:32:23.967351 4992 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39420
I20260807 13:32:23.967870 4992 raft_consensus.cc:595] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:23.978755 4992 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39420
I20260807 13:32:23.979210 4992 raft_consensus.cc:595] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:23.983613 4886 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39714
I20260807 13:32:23.984077 4886 raft_consensus.cc:595] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:23.988102 4886 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39714
I20260807 13:32:23.988535 4886 raft_consensus.cc:595] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:23.992290 4886 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
mode: GRACEFUL
new_leader_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:39714
I20260807 13:32:23.992705 4886 raft_consensus.cc:595] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Received request to transfer leadership to TS c8c665d676074226af419c349506f887
I20260807 13:32:24.093539 5110 raft_consensus.cc:979] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.093991 5243 raft_consensus.cc:1067] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.095366 4759 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55084
I20260807 13:32:24.095781 4759 raft_consensus.cc:482] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:24.096029 4759 raft_consensus.cc:3037] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:24.101171 4759 raft_consensus.cc:504] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.102795 4759 leader_election.cc:288] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:24.103542 4886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:24.103734 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0c46a5d3a94fee84a44720af8d30bd" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:24.104228 4886 raft_consensus.cc:3032] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:24.104269 4992 raft_consensus.cc:3037] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:24.104615 4886 raft_consensus.cc:729] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:24.105309 4886 consensus_queue.cc:260] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.106349 4886 raft_consensus.cc:3037] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:24.108860 4992 raft_consensus.cc:2454] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:24.110050 4713 leader_election.cc:302] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:24.110877 5196 raft_consensus.cc:2781] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:24.111310 4886 raft_consensus.cc:2454] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 2.
I20260807 13:32:24.111835 5196 raft_consensus.cc:686] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:24.112645 5196 consensus_queue.cc:237] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.118278 4623 catalog_manager.cc:5495] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 reported cstate change: term changed from 1 to 2, leader changed from a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 2 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:24.178717 5254 raft_consensus.cc:979] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.179167 5240 raft_consensus.cc:1067] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.180531 4759 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55092
I20260807 13:32:24.180980 4759 raft_consensus.cc:482] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:24.181229 4759 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:32:24.185745 4759 raft_consensus.cc:504] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.187099 4759 leader_election.cc:288] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 4 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:24.187901 4886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:24.188050 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:24.188416 4886 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:32:24.188555 4992 raft_consensus.cc:3032] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:32:24.188926 4992 raft_consensus.cc:729] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:24.189517 4992 consensus_queue.cc:260] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.190441 4992 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:32:24.194394 4886 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 4.
I20260807 13:32:24.195469 4712 leader_election.cc:302] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:24.195586 4992 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 4.
I20260807 13:32:24.196165 5196 raft_consensus.cc:2781] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:32:24.196575 5196 raft_consensus.cc:686] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:24.197225 5196 consensus_queue.cc:237] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.200579 5110 raft_consensus.cc:979] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.201071 5243 raft_consensus.cc:1067] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.202332 4759 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55084
I20260807 13:32:24.202802 4759 raft_consensus.cc:482] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:24.203128 4759 raft_consensus.cc:3037] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:24.204600 4623 catalog_manager.cc:5495] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 reported cstate change: term changed from 3 to 4, leader changed from 599c0b06734d46dba4877a2de293bb16 (127.3.187.195) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 4 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:24.208441 4759 raft_consensus.cc:504] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.210002 4759 leader_election.cc:288] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 3 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:24.210605 4886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:24.211162 4886 raft_consensus.cc:3032] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:32:24.211359 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a0f46c814924b0e92ab52c2152465a1" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:24.211473 4886 raft_consensus.cc:729] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:24.211959 4992 raft_consensus.cc:3037] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:24.212594 4886 consensus_queue.cc:260] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.214847 4886 raft_consensus.cc:3037] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:24.216152 4992 raft_consensus.cc:2454] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 3.
I20260807 13:32:24.216922 4713 leader_election.cc:302] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:24.217492 5196 raft_consensus.cc:2781] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:32:24.217821 5196 raft_consensus.cc:686] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 3 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:24.218462 5196 consensus_queue.cc:237] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.219660 4886 raft_consensus.cc:2454] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 3.
I20260807 13:32:24.226732 4623 catalog_manager.cc:5495] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 reported cstate change: term changed from 2 to 3, leader changed from a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 3 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:24.324129 5110 raft_consensus.cc:979] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.324548 5243 raft_consensus.cc:1067] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.325702 4759 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55084
I20260807 13:32:24.326232 4759 raft_consensus.cc:482] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:24.326543 4759 raft_consensus.cc:3037] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:24.331069 4759 raft_consensus.cc:504] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.332645 4759 leader_election.cc:288] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 3 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:24.333340 4886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:24.333544 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed4d9054df34376a505c804320f61e4" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:24.333945 4886 raft_consensus.cc:3032] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:32:24.334005 4992 raft_consensus.cc:3037] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:24.334421 4886 raft_consensus.cc:729] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:24.335247 4886 consensus_queue.cc:260] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.336441 4886 raft_consensus.cc:3037] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:24.339296 4992 raft_consensus.cc:2454] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 3.
I20260807 13:32:24.340225 4713 leader_election.cc:302] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:24.340932 5196 raft_consensus.cc:2781] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:32:24.341313 5196 raft_consensus.cc:686] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 3 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:24.342072 5196 consensus_queue.cc:237] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:24.342628 4886 raft_consensus.cc:2454] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 3.
I20260807 13:32:24.345698 5254 raft_consensus.cc:979] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16: : Instructing follower c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.346217 5240 raft_consensus.cc:1067] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Signalling peer c8c665d676074226af419c349506f887 to start an election
I20260807 13:32:24.347620 4759 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0"
dest_uuid: "c8c665d676074226af419c349506f887"
from {username='slave'} at 127.0.0.1:55092
I20260807 13:32:24.348028 4759 raft_consensus.cc:482] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:24.348291 4759 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:32:24.348773 4623 catalog_manager.cc:5495] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 reported cstate change: term changed from 2 to 3, leader changed from a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 3 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:24.352227 4759 raft_consensus.cc:504] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:24.354084 4759 leader_election.cc:288] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 4 election: Requested vote from peers 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:24.355435 4886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:24.355713 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "c8c665d676074226af419c349506f887" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:24.355894 4886 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:32:24.356225 4992 raft_consensus.cc:3032] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:32:24.356500 4992 raft_consensus.cc:729] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:24.357120 4992 consensus_queue.cc:260] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:24.357978 4992 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:32:24.360442 4886 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 4.
I20260807 13:32:24.361289 4712 leader_election.cc:302] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a873f49ccdd84afd86937a5ff9a30503, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:24.361759 4992 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c665d676074226af419c349506f887 in term 4.
I20260807 13:32:24.361894 5196 raft_consensus.cc:2781] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:32:24.362346 5196 raft_consensus.cc:686] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Becoming Leader. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:24.363124 5196 consensus_queue.cc:237] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:24.368638 4623 catalog_manager.cc:5495] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 reported cstate change: term changed from 3 to 4, leader changed from 599c0b06734d46dba4877a2de293bb16 (127.3.187.195) to c8c665d676074226af419c349506f887 (127.3.187.193). New cstate: current_term: 4 leader_uuid: "c8c665d676074226af419c349506f887" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:24.639484 4992 raft_consensus.cc:1261] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 4 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:32:24.641029 5196 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:32:24.650619 4992 raft_consensus.cc:1261] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:24.656244 5196 consensus_queue.cc:1035] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:24.665215 4884 raft_consensus.cc:1261] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 4 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:32:24.665380 4886 raft_consensus.cc:1261] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:24.667578 5268 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:32:24.667984 5244 consensus_queue.cc:1035] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:32:24.679219 4992 raft_consensus.cc:1261] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:24.680701 5268 consensus_queue.cc:1035] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:24.698724 4884 raft_consensus.cc:1261] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:24.699900 5268 consensus_queue.cc:1035] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:24.818149 4991 raft_consensus.cc:1261] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:24.819319 5282 consensus_queue.cc:1035] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:24.828125 4884 raft_consensus.cc:1261] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:24.829317 5282 consensus_queue.cc:1035] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:24.905197 4991 raft_consensus.cc:1261] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 4 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:32:24.906488 5268 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:24.915611 4884 raft_consensus.cc:1261] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 4 FOLLOWER]: Refusing update from remote peer c8c665d676074226af419c349506f887: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 13:32:24.917238 5282 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:27.024945 3823 auto_leader_rebalancer-test.cc:373] The leader distribution is
I20260807 13:32:27.025609 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:27.032312 4759 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255"
dest_uuid: "c8c665d676074226af419c349506f887"
mode: GRACEFUL
new_leader_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:55100
I20260807 13:32:27.032917 4759 raft_consensus.cc:595] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Received request to transfer leadership to TS a873f49ccdd84afd86937a5ff9a30503
I20260807 13:32:27.035279 4759 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7"
dest_uuid: "c8c665d676074226af419c349506f887"
mode: GRACEFUL
new_leader_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:55100
I20260807 13:32:27.035787 4759 raft_consensus.cc:595] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Received request to transfer leadership to TS a873f49ccdd84afd86937a5ff9a30503
I20260807 13:32:27.037660 4759 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0"
dest_uuid: "c8c665d676074226af419c349506f887"
mode: GRACEFUL
new_leader_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:55100
I20260807 13:32:27.038133 4759 raft_consensus.cc:595] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Received request to transfer leadership to TS 599c0b06734d46dba4877a2de293bb16
I20260807 13:32:27.040079 4759 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291"
dest_uuid: "c8c665d676074226af419c349506f887"
mode: GRACEFUL
new_leader_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:55100
I20260807 13:32:27.040540 4759 raft_consensus.cc:595] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Received request to transfer leadership to TS 599c0b06734d46dba4877a2de293bb16
I20260807 13:32:27.041508 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 13:32:27.041922 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:27.329306 5295 raft_consensus.cc:979] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887: : Instructing follower 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:27.330503 5295 raft_consensus.cc:1067] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Signalling peer 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:27.330783 5297 raft_consensus.cc:979] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887: : Instructing follower a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:27.331346 5293 raft_consensus.cc:1067] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Signalling peer a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:27.332175 4991 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:39418
I20260807 13:32:27.332752 4991 raft_consensus.cc:482] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:27.332823 4884 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:39702
I20260807 13:32:27.333184 4991 raft_consensus.cc:3037] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:27.333370 4884 raft_consensus.cc:482] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:27.333793 4884 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:32:27.336359 5295 raft_consensus.cc:979] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887: : Instructing follower a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:27.336813 5295 raft_consensus.cc:1067] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Signalling peer a873f49ccdd84afd86937a5ff9a30503 to start an election
I20260807 13:32:27.338268 4886 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255"
dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
from {username='slave'} at 127.0.0.1:39702
I20260807 13:32:27.338754 4886 raft_consensus.cc:482] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:27.339085 4886 raft_consensus.cc:3037] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:27.340519 4884 raft_consensus.cc:504] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:27.341773 4991 raft_consensus.cc:504] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:27.343582 4992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:27.343616 4759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "366df500c3634b0180c70a000da5c1d7" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:27.344303 4992 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:32:27.344318 4759 raft_consensus.cc:3032] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:32:27.344775 4759 raft_consensus.cc:729] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:27.344869 4991 leader_election.cc:288] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 3 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587)
I20260807 13:32:27.345677 4886 raft_consensus.cc:504] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:27.345633 4759 consensus_queue.cc:260] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:27.346653 4885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:27.347218 4885 raft_consensus.cc:3037] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:27.347666 4886 leader_election.cc:288] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 3 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:27.344333 4884 leader_election.cc:288] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 5 election: Requested vote from peers c8c665d676074226af419c349506f887 (127.3.187.193:43021), 599c0b06734d46dba4877a2de293bb16 (127.3.187.195:36775)
I20260807 13:32:27.348647 4991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "599c0b06734d46dba4877a2de293bb16"
I20260807 13:32:27.349205 4991 raft_consensus.cc:3037] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:27.350059 4992 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 5.
I20260807 13:32:27.351256 4763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e2623235a5400ebe1df26bbd12e291" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:27.351794 4763 raft_consensus.cc:3032] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:32:27.352043 4763 raft_consensus.cc:729] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:27.352725 4763 consensus_queue.cc:260] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:27.353066 4761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ad3a8f426f4f6fba240b0dc96ee255" candidate_uuid: "a873f49ccdd84afd86937a5ff9a30503" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:27.353658 4761 raft_consensus.cc:3032] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:32:27.353983 4761 raft_consensus.cc:729] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:27.353988 4763 raft_consensus.cc:3037] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:27.354890 4885 raft_consensus.cc:2454] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 3.
I20260807 13:32:27.354833 4761 consensus_queue.cc:260] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:27.355743 4991 raft_consensus.cc:2454] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 3.
I20260807 13:32:27.356259 4761 raft_consensus.cc:3037] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:32:27.356309 4941 leader_election.cc:302] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters:
I20260807 13:32:27.357208 5294 raft_consensus.cc:2781] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:32:27.357725 4834 leader_election.cc:302] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters:
I20260807 13:32:27.358649 5243 raft_consensus.cc:2781] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:32:27.358688 4834 leader_election.cc:302] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, a873f49ccdd84afd86937a5ff9a30503; no voters:
I20260807 13:32:27.347232 4759 raft_consensus.cc:3037] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:32:27.361570 4763 raft_consensus.cc:2454] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 3.
I20260807 13:32:27.372110 5243 raft_consensus.cc:686] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 5 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:27.372762 5300 raft_consensus.cc:2781] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:32:27.373286 5300 raft_consensus.cc:686] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 3 LEADER]: Becoming Leader. State: Replica: a873f49ccdd84afd86937a5ff9a30503, State: Running, Role: LEADER
I20260807 13:32:27.374467 5300 consensus_queue.cc:237] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:27.373317 5243 consensus_queue.cc:237] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:27.381721 5293 raft_consensus.cc:979] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887: : Instructing follower 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:27.382428 5293 raft_consensus.cc:1067] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Signalling peer 599c0b06734d46dba4877a2de293bb16 to start an election
I20260807 13:32:27.383930 5294 raft_consensus.cc:686] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:27.384220 4992 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0"
dest_uuid: "599c0b06734d46dba4877a2de293bb16"
from {username='slave'} at 127.0.0.1:39418
I20260807 13:32:27.384954 5294 consensus_queue.cc:237] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } }
I20260807 13:32:27.385607 4992 raft_consensus.cc:482] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:32:27.386974 4992 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:32:27.387630 4761 raft_consensus.cc:2454] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 3.
I20260807 13:32:27.395973 4623 catalog_manager.cc:5495] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 4 to 5, leader changed from c8c665d676074226af419c349506f887 (127.3.187.193) to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 5 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:27.389887 4759 raft_consensus.cc:2454] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a873f49ccdd84afd86937a5ff9a30503 in term 5.
I20260807 13:32:27.397868 4625 catalog_manager.cc:5495] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 2 to 3, leader changed from c8c665d676074226af419c349506f887 (127.3.187.193) to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:27.401438 4992 raft_consensus.cc:504] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:27.402890 4992 leader_election.cc:288] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 5 election: Requested vote from peers a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587), c8c665d676074226af419c349506f887 (127.3.187.193:43021)
I20260807 13:32:27.403848 4759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c8c665d676074226af419c349506f887"
I20260807 13:32:27.404333 4759 raft_consensus.cc:3032] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:32:27.404722 4759 raft_consensus.cc:729] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c8c665d676074226af419c349506f887, State: Running, Role: LEADER
I20260807 13:32:27.404567 4885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c15b7a03dc74874adde4ceeaad27dc0" candidate_uuid: "599c0b06734d46dba4877a2de293bb16" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a873f49ccdd84afd86937a5ff9a30503"
I20260807 13:32:27.405804 4759 consensus_queue.cc:260] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:27.406086 4885 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:32:27.407521 4759 raft_consensus.cc:3037] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:32:27.416716 4759 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 5.
I20260807 13:32:27.418416 4885 raft_consensus.cc:2454] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599c0b06734d46dba4877a2de293bb16 in term 5.
I20260807 13:32:27.418298 4939 leader_election.cc:302] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599c0b06734d46dba4877a2de293bb16, c8c665d676074226af419c349506f887; no voters:
I20260807 13:32:27.419997 5294 raft_consensus.cc:2781] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:32:27.420789 5294 raft_consensus.cc:686] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 5 LEADER]: Becoming Leader. State: Replica: 599c0b06734d46dba4877a2de293bb16, State: Running, Role: LEADER
I20260807 13:32:27.422214 5294 consensus_queue.cc:237] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } }
I20260807 13:32:27.434350 4625 catalog_manager.cc:5495] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 reported cstate change: term changed from 2 to 3, leader changed from c8c665d676074226af419c349506f887 (127.3.187.193) to a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194). New cstate: current_term: 3 leader_uuid: "a873f49ccdd84afd86937a5ff9a30503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:27.438930 4623 catalog_manager.cc:5495] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 reported cstate change: term changed from 4 to 5, leader changed from c8c665d676074226af419c349506f887 (127.3.187.193) to 599c0b06734d46dba4877a2de293bb16 (127.3.187.195). New cstate: current_term: 5 leader_uuid: "599c0b06734d46dba4877a2de293bb16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:27.806663 4885 raft_consensus.cc:1261] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 5 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:32:27.808357 5294 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:32:27.813153 4759 raft_consensus.cc:1261] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:27.814755 5294 consensus_queue.cc:1035] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:27.837527 4761 raft_consensus.cc:1261] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 5 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:32:27.841012 5294 consensus_queue.cc:1035] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:32:27.847627 4885 raft_consensus.cc:1261] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Refusing update from remote peer 599c0b06734d46dba4877a2de293bb16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:27.853180 5299 consensus_queue.cc:1035] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a873f49ccdd84afd86937a5ff9a30503" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:27.866575 4759 raft_consensus.cc:1261] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 5 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:32:27.868386 5300 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:32:27.876868 4992 raft_consensus.cc:1261] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:27.878858 5243 consensus_queue.cc:1035] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:27.890224 4991 raft_consensus.cc:1261] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 5 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:32:27.893893 5302 consensus_queue.cc:1035] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599c0b06734d46dba4877a2de293bb16" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260807 13:32:27.903240 4761 raft_consensus.cc:1261] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Refusing update from remote peer a873f49ccdd84afd86937a5ff9a30503: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:32:27.906327 5329 consensus_queue.cc:1035] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8c665d676074226af419c349506f887" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260807 13:32:28.042726 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:28.047596 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:28.047911 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:29.048684 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:29.054044 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:29.054391 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:30.055158 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:30.060724 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:30.061144 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:31.062032 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:31.067147 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:31.067534 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:32.068305 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:32.073560 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:32.073971 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:33.074743 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:33.080191 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:33.080664 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:34.081478 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:34.086730 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:34.087100 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:35.088234 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:35.094353 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:35.094758 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:36.095527 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:32:36.101285 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 13:32:36.101706 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:32:37.134984 3823 auto_leader_rebalancer-test.cc:384] The leader distribution is
I20260807 13:32:37.136016 3823 tablet_server.cc:178] TabletServer@127.3.187.193:0 shutting down...
I20260807 13:32:37.173610 3823 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:32:37.174374 3823 tablet_replica.cc:330] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.175009 3823 raft_consensus.cc:2229] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.175942 3823 raft_consensus.cc:2258] T 4e0c46a5d3a94fee84a44720af8d30bd P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.177879 3823 tablet_replica.cc:330] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.178472 3823 raft_consensus.cc:2229] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.178941 3823 raft_consensus.cc:2258] T 038d9af0b5d6451fb19a7bc99107fee0 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.180815 3823 tablet_replica.cc:330] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.181262 3823 raft_consensus.cc:2229] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.181744 3823 raft_consensus.cc:2258] T 08ad3a8f426f4f6fba240b0dc96ee255 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.183830 3823 tablet_replica.cc:330] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.184340 3823 raft_consensus.cc:2229] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.185067 3823 raft_consensus.cc:2258] T 5a0f46c814924b0e92ab52c2152465a1 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.186784 3823 tablet_replica.cc:330] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.187288 3823 raft_consensus.cc:2229] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.188114 3823 raft_consensus.cc:2258] T 146ee52a9e2f4d8b8146f273bfe20c2e P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.189744 3823 tablet_replica.cc:330] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.190275 3823 raft_consensus.cc:2229] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.190671 3823 raft_consensus.cc:2258] T 3ca69c36b4e44b7bb5529010fcc63122 P c8c665d676074226af419c349506f887 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.192323 3823 tablet_replica.cc:330] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.192862 3823 raft_consensus.cc:2229] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.193596 3823 raft_consensus.cc:2258] T 9ed4d9054df34376a505c804320f61e4 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.195361 3823 tablet_replica.cc:330] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.195824 3823 raft_consensus.cc:2229] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.196225 3823 raft_consensus.cc:2258] T 366df500c3634b0180c70a000da5c1d7 P c8c665d676074226af419c349506f887 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.197813 3823 tablet_replica.cc:330] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.198357 3823 raft_consensus.cc:2229] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.198794 3823 raft_consensus.cc:2258] T e8e2623235a5400ebe1df26bbd12e291 P c8c665d676074226af419c349506f887 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.200445 3823 tablet_replica.cc:330] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887: stopping tablet replica
I20260807 13:32:37.200891 3823 raft_consensus.cc:2229] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.201285 3823 raft_consensus.cc:2258] T 4c15b7a03dc74874adde4ceeaad27dc0 P c8c665d676074226af419c349506f887 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260807 13:32:37.227353 4824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.187.193:43021: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260807 13:32:37.230728 4824 consensus_peers.cc:487] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 -> Peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Couldn't send request to peer c8c665d676074226af419c349506f887. Status: Network error: Client connection negotiation failed: client connection to 127.3.187.193:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:37.232389 3823 tablet_server.cc:194] TabletServer@127.3.187.193:0 shutdown complete.
W20260807 13:32:37.247365 4939 consensus_peers.cc:487] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 -> Peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Couldn't send request to peer c8c665d676074226af419c349506f887. Status: Network error: Client connection negotiation failed: client connection to 127.3.187.193:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:37.252852 3823 tablet_server.cc:178] TabletServer@127.3.187.194:0 shutting down...
W20260807 13:32:37.275259 4824 consensus_peers.cc:487] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 -> Peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Couldn't send request to peer c8c665d676074226af419c349506f887. Status: Network error: Client connection negotiation failed: client connection to 127.3.187.193:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:37.282728 3823 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:32:37.284245 3823 tablet_replica.cc:330] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.285197 3823 raft_consensus.cc:2229] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.285868 3823 raft_consensus.cc:2258] T 038d9af0b5d6451fb19a7bc99107fee0 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.287716 3823 tablet_replica.cc:330] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.288260 3823 raft_consensus.cc:2229] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.288723 3823 raft_consensus.cc:2258] T 4e0c46a5d3a94fee84a44720af8d30bd P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.290529 3823 tablet_replica.cc:330] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.291024 3823 raft_consensus.cc:2229] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.291950 3823 raft_consensus.cc:2258] T 3ca69c36b4e44b7bb5529010fcc63122 P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.294157 3823 tablet_replica.cc:330] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.294715 3823 raft_consensus.cc:2229] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.295157 3823 raft_consensus.cc:2258] T e8e2623235a5400ebe1df26bbd12e291 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.296684 3823 tablet_replica.cc:330] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.297153 3823 raft_consensus.cc:2229] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.297547 3823 raft_consensus.cc:2258] T 9ed4d9054df34376a505c804320f61e4 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.299120 3823 tablet_replica.cc:330] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.299582 3823 raft_consensus.cc:2229] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 5 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.300279 3823 raft_consensus.cc:2258] T 366df500c3634b0180c70a000da5c1d7 P a873f49ccdd84afd86937a5ff9a30503 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.301831 3823 tablet_replica.cc:330] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.302356 3823 raft_consensus.cc:2229] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.302767 3823 raft_consensus.cc:2258] T 5a0f46c814924b0e92ab52c2152465a1 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.304277 3823 tablet_replica.cc:330] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.304723 3823 raft_consensus.cc:2229] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.305124 3823 raft_consensus.cc:2258] T 146ee52a9e2f4d8b8146f273bfe20c2e P a873f49ccdd84afd86937a5ff9a30503 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.306643 3823 tablet_replica.cc:330] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.307078 3823 raft_consensus.cc:2229] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.307790 3823 raft_consensus.cc:2258] T 08ad3a8f426f4f6fba240b0dc96ee255 P a873f49ccdd84afd86937a5ff9a30503 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.309306 3823 tablet_replica.cc:330] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503: stopping tablet replica
I20260807 13:32:37.309769 3823 raft_consensus.cc:2229] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.310338 3823 raft_consensus.cc:2258] T 4c15b7a03dc74874adde4ceeaad27dc0 P a873f49ccdd84afd86937a5ff9a30503 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.339051 3823 tablet_server.cc:194] TabletServer@127.3.187.194:0 shutdown complete.
W20260807 13:32:37.351044 4941 consensus_peers.cc:487] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 -> Peer a873f49ccdd84afd86937a5ff9a30503 (127.3.187.194:35587): Couldn't send request to peer a873f49ccdd84afd86937a5ff9a30503. Status: Network error: Client connection negotiation failed: client connection to 127.3.187.194:35587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 13:32:37.352209 4939 consensus_peers.cc:487] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 -> Peer c8c665d676074226af419c349506f887 (127.3.187.193:43021): Couldn't send request to peer c8c665d676074226af419c349506f887. Status: Network error: Client connection negotiation failed: client connection to 127.3.187.193:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:37.367271 3823 tablet_server.cc:178] TabletServer@127.3.187.195:0 shutting down...
I20260807 13:32:37.392323 3823 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260807 13:32:37.393011 3823 tablet_replica.cc:330] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.393595 3823 raft_consensus.cc:2229] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 2 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.394503 3823 raft_consensus.cc:2258] T 038d9af0b5d6451fb19a7bc99107fee0 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.396313 3823 tablet_replica.cc:330] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.396839 3823 raft_consensus.cc:2229] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.397248 3823 raft_consensus.cc:2258] T 4e0c46a5d3a94fee84a44720af8d30bd P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.398818 3823 tablet_replica.cc:330] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.399294 3823 raft_consensus.cc:2229] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.399724 3823 raft_consensus.cc:2258] T 366df500c3634b0180c70a000da5c1d7 P 599c0b06734d46dba4877a2de293bb16 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.401257 3823 tablet_replica.cc:330] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.401721 3823 raft_consensus.cc:2229] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.402205 3823 raft_consensus.cc:2258] T 3ca69c36b4e44b7bb5529010fcc63122 P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.403757 3823 tablet_replica.cc:330] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.404225 3823 raft_consensus.cc:2229] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 3 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.404939 3823 raft_consensus.cc:2258] T e8e2623235a5400ebe1df26bbd12e291 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.406528 3823 tablet_replica.cc:330] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.407001 3823 raft_consensus.cc:2229] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.407409 3823 raft_consensus.cc:2258] T 9ed4d9054df34376a505c804320f61e4 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.408883 3823 tablet_replica.cc:330] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.409320 3823 raft_consensus.cc:2229] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.409730 3823 raft_consensus.cc:2258] T 5a0f46c814924b0e92ab52c2152465a1 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.411260 3823 tablet_replica.cc:330] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.411732 3823 raft_consensus.cc:2229] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.412127 3823 raft_consensus.cc:2258] T 146ee52a9e2f4d8b8146f273bfe20c2e P 599c0b06734d46dba4877a2de293bb16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.413546 3823 tablet_replica.cc:330] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.414016 3823 raft_consensus.cc:2229] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:37.414465 3823 raft_consensus.cc:2258] T 08ad3a8f426f4f6fba240b0dc96ee255 P 599c0b06734d46dba4877a2de293bb16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.415910 3823 tablet_replica.cc:330] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16: stopping tablet replica
I20260807 13:32:37.416356 3823 raft_consensus.cc:2229] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 5 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.417026 3823 raft_consensus.cc:2258] T 4c15b7a03dc74874adde4ceeaad27dc0 P 599c0b06734d46dba4877a2de293bb16 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.445482 3823 tablet_server.cc:194] TabletServer@127.3.187.195:0 shutdown complete.
I20260807 13:32:37.464471 3823 master.cc:537] Master@127.3.187.254:41407 shutting down...
I20260807 13:32:37.486745 3823 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 1 LEADER]: Raft consensus shutting down.
I20260807 13:32:37.487264 3823 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:37.487579 3823 tablet_replica.cc:330] T 00000000000000000000000000000000 P c18db01974f349cfa802dde8b6a33c49: stopping tablet replica
I20260807 13:32:37.504770 3823 master.cc:552] Master@127.3.187.254:41407 shutdown complete.
599c0b06734d46dba4877a2de293bb16 1
a873f49ccdd84afd86937a5ff9a30503 4
c8c665d676074226af419c349506f887 5
599c0b06734d46dba4877a2de293bb16 3
a873f49ccdd84afd86937a5ff9a30503 4
c8c665d676074226af419c349506f887 3
599c0b06734d46dba4877a2de293bb16 1
a873f49ccdd84afd86937a5ff9a30503 1
c8c665d676074226af419c349506f887 8
599c0b06734d46dba4877a2de293bb16 3
a873f49ccdd84afd86937a5ff9a30503 3
c8c665d676074226af419c349506f887 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28611 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260807 13:32:37.546145 3823 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.187.254:34519
I20260807 13:32:37.547181 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:32:37.553035 5358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:37.553077 5357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:37.553719 5360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:37.560546 3823 server_base.cc:1034] running on GCE node
I20260807 13:32:37.561558 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:32:37.561758 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:32:37.561908 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109557561893 us; error 0 us; skew 500 ppm
I20260807 13:32:37.562518 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:32:37.569208 3823 webserver.cc:460] Webserver started at http://127.3.187.254:41643/ using document root <none> and password file <none>
I20260807 13:32:37.569682 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:32:37.569875 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:32:37.570216 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:32:37.571421 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/master-0-root/instance:
uuid: "a9f384d8e9094a008ffb096177d1785c"
format_stamp: "Formatted at 2026-08-07 13:32:37 on dist-test-slave-d17x"
I20260807 13:32:37.575958 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 13:32:37.578974 5368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:37.579735 3823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 13:32:37.579994 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/master-0-root
uuid: "a9f384d8e9094a008ffb096177d1785c"
format_stamp: "Formatted at 2026-08-07 13:32:37 on dist-test-slave-d17x"
I20260807 13:32:37.580273 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:32:37.605722 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:32:37.606913 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:32:37.643911 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.254:34519
I20260807 13:32:37.644007 5446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.254:34519 every 8 connection(s)
I20260807 13:32:37.647850 5449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:37.657213 5449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Bootstrap starting.
I20260807 13:32:37.661626 5449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:37.665669 5449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: No bootstrap required, opened a new log
I20260807 13:32:37.667699 5449 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9f384d8e9094a008ffb096177d1785c" member_type: VOTER }
I20260807 13:32:37.668164 5449 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:37.668417 5449 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9f384d8e9094a008ffb096177d1785c, State: Initialized, Role: FOLLOWER
I20260807 13:32:37.669075 5449 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9f384d8e9094a008ffb096177d1785c" member_type: VOTER }
I20260807 13:32:37.669525 5449 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 13:32:37.669771 5449 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 13:32:37.670053 5449 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:37.673568 5449 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9f384d8e9094a008ffb096177d1785c" member_type: VOTER }
I20260807 13:32:37.674085 5449 leader_election.cc:302] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9f384d8e9094a008ffb096177d1785c; no voters:
I20260807 13:32:37.675223 5449 leader_election.cc:288] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 13:32:37.675635 5455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:37.676977 5455 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [term 1 LEADER]: Becoming Leader. State: Replica: a9f384d8e9094a008ffb096177d1785c, State: Running, Role: LEADER
I20260807 13:32:37.677667 5455 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9f384d8e9094a008ffb096177d1785c" member_type: VOTER }
I20260807 13:32:37.678180 5449 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 13:32:37.683688 5456 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9f384d8e9094a008ffb096177d1785c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9f384d8e9094a008ffb096177d1785c" member_type: VOTER } }
I20260807 13:32:37.683772 5458 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9f384d8e9094a008ffb096177d1785c. Latest consensus state: current_term: 1 leader_uuid: "a9f384d8e9094a008ffb096177d1785c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9f384d8e9094a008ffb096177d1785c" member_type: VOTER } }
I20260807 13:32:37.684453 5456 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [sys.catalog]: This master's current role is: LEADER
I20260807 13:32:37.684566 5458 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c [sys.catalog]: This master's current role is: LEADER
I20260807 13:32:37.693215 5467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 13:32:37.699209 5467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 13:32:37.700224 3823 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 13:32:37.707621 5467 catalog_manager.cc:1347] Generated new cluster ID: 8b8a7e47f4bb4064a92e72c67d3615e4
I20260807 13:32:37.707863 5467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 13:32:37.729992 5467 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 13:32:37.731662 5467 catalog_manager.cc:1504] Loading token signing keys...
I20260807 13:32:37.745520 5467 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Generated new TSK 0
I20260807 13:32:37.746170 5467 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 13:32:37.766597 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:32:37.771996 5484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:37.773371 5485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:37.775135 5488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:37.775792 3823 server_base.cc:1034] running on GCE node
I20260807 13:32:37.776667 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:32:37.776866 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:32:37.777019 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109557776989 us; error 0 us; skew 500 ppm
I20260807 13:32:37.777508 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:32:37.779784 3823 webserver.cc:460] Webserver started at http://127.3.187.193:35803/ using document root <none> and password file <none>
I20260807 13:32:37.780236 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:32:37.780426 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:32:37.780676 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:32:37.781798 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-0-root/instance:
uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
format_stamp: "Formatted at 2026-08-07 13:32:37 on dist-test-slave-d17x"
I20260807 13:32:37.786053 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 13:32:37.789222 5497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:37.790086 3823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 13:32:37.790362 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-0-root
uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
format_stamp: "Formatted at 2026-08-07 13:32:37 on dist-test-slave-d17x"
I20260807 13:32:37.790607 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:32:37.813772 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:32:37.814924 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:32:37.816232 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:32:37.818449 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:32:37.818619 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:37.818888 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:32:37.819036 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:37.857991 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.193:39143
I20260807 13:32:37.858084 5594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.193:39143 every 8 connection(s)
I20260807 13:32:37.862514 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:32:37.870090 5602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:37.871068 5603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:37.873489 5608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:37.873665 3823 server_base.cc:1034] running on GCE node
I20260807 13:32:37.875622 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:32:37.875797 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:32:37.876004 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109557875973 us; error 0 us; skew 500 ppm
I20260807 13:32:37.876529 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:32:37.878372 5596 heartbeater.cc:347] Connected to a master server at 127.3.187.254:34519
I20260807 13:32:37.878732 5596 heartbeater.cc:464] Registering TS with master...
I20260807 13:32:37.879470 3823 webserver.cc:460] Webserver started at http://127.3.187.194:44045/ using document root <none> and password file <none>
I20260807 13:32:37.879524 5596 heartbeater.cc:511] Master 127.3.187.254:34519 requested a full tablet report, sending...
I20260807 13:32:37.880107 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:32:37.880365 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:32:37.880640 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:32:37.881927 5394 ts_manager.cc:194] Registered new tserver with Master: 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143)
I20260807 13:32:37.882035 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-1-root/instance:
uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
format_stamp: "Formatted at 2026-08-07 13:32:37 on dist-test-slave-d17x"
I20260807 13:32:37.883829 5394 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51200
I20260807 13:32:37.886884 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 13:32:37.889979 5614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:37.890741 3823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 13:32:37.891006 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-1-root
uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
format_stamp: "Formatted at 2026-08-07 13:32:37 on dist-test-slave-d17x"
I20260807 13:32:37.891335 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:32:37.908805 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:32:37.909878 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:32:37.911325 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:32:37.913342 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:32:37.913550 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:37.913807 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:32:37.913975 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:37.952562 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.194:42569
I20260807 13:32:37.952684 5702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.194:42569 every 8 connection(s)
I20260807 13:32:37.957199 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:32:37.963552 5707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:37.964643 5709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:37.967020 5713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:37.967799 3823 server_base.cc:1034] running on GCE node
I20260807 13:32:37.968765 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:32:37.968997 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:32:37.969177 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109557969163 us; error 0 us; skew 500 ppm
I20260807 13:32:37.969784 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:32:37.971819 5703 heartbeater.cc:347] Connected to a master server at 127.3.187.254:34519
I20260807 13:32:37.972265 5703 heartbeater.cc:464] Registering TS with master...
I20260807 13:32:37.972541 3823 webserver.cc:460] Webserver started at http://127.3.187.195:43357/ using document root <none> and password file <none>
I20260807 13:32:37.973067 5703 heartbeater.cc:511] Master 127.3.187.254:34519 requested a full tablet report, sending...
I20260807 13:32:37.973177 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:32:37.973500 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:32:37.973839 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:32:37.975291 5394 ts_manager.cc:194] Registered new tserver with Master: 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:37.975271 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-2-root/instance:
uuid: "737c581af06a42df94970a1542600159"
format_stamp: "Formatted at 2026-08-07 13:32:37 on dist-test-slave-d17x"
I20260807 13:32:37.977582 5394 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51216
I20260807 13:32:37.981179 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 13:32:37.984496 5718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:37.985203 3823 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 13:32:37.985474 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-2-root
uuid: "737c581af06a42df94970a1542600159"
format_stamp: "Formatted at 2026-08-07 13:32:37 on dist-test-slave-d17x"
I20260807 13:32:37.985725 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:32:38.005366 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:32:38.006480 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:32:38.007826 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:32:38.009915 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:32:38.010140 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:38.010422 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:32:38.010586 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:38.051000 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.195:43427
I20260807 13:32:38.051096 5805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.195:43427 every 8 connection(s)
I20260807 13:32:38.065554 5807 heartbeater.cc:347] Connected to a master server at 127.3.187.254:34519
I20260807 13:32:38.065887 5807 heartbeater.cc:464] Registering TS with master...
I20260807 13:32:38.066628 5807 heartbeater.cc:511] Master 127.3.187.254:34519 requested a full tablet report, sending...
I20260807 13:32:38.068341 5394 ts_manager.cc:194] Registered new tserver with Master: 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:38.068823 3823 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.0146576s
I20260807 13:32:38.070590 5394 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51228
I20260807 13:32:38.071585 3823 test_util.cc:268] Using random seed: 163389704
I20260807 13:32:38.097123 5394 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51238:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 13:32:38.103075 5394 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 13:32:38.305454 5655 tablet_service.cc:1467] Processing CreateTablet for tablet 37b9562e68354bc69b54b07a09406578 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 13:32:38.306973 5655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37b9562e68354bc69b54b07a09406578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.307189 5654 tablet_service.cc:1467] Processing CreateTablet for tablet dc4a6a8da3ec47dc859ce24a3852828d (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 13:32:38.308480 5654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc4a6a8da3ec47dc859ce24a3852828d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.311314 5653 tablet_service.cc:1467] Processing CreateTablet for tablet 507708159cfa4a0885418e218939cd02 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 13:32:38.312026 5541 tablet_service.cc:1467] Processing CreateTablet for tablet 37b9562e68354bc69b54b07a09406578 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 13:32:38.312633 5653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507708159cfa4a0885418e218939cd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.312391 5537 tablet_service.cc:1467] Processing CreateTablet for tablet dc4a6a8da3ec47dc859ce24a3852828d (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 13:32:38.313308 5541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37b9562e68354bc69b54b07a09406578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.313953 5537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc4a6a8da3ec47dc859ce24a3852828d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.314677 5530 tablet_service.cc:1467] Processing CreateTablet for tablet f9bb2629a0e741fbb67f5b64ab12e4d8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 13:32:38.315284 5535 tablet_service.cc:1467] Processing CreateTablet for tablet 507708159cfa4a0885418e218939cd02 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 13:32:38.316009 5530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9bb2629a0e741fbb67f5b64ab12e4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.316613 5535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507708159cfa4a0885418e218939cd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.316462 5651 tablet_service.cc:1467] Processing CreateTablet for tablet b3566608e8e74f10a291207e9cb298b8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 13:32:38.317709 5651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3566608e8e74f10a291207e9cb298b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.315304 5652 tablet_service.cc:1467] Processing CreateTablet for tablet 5aa7518c16b1482b87aa72990193cafd (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 13:32:38.319392 5652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5aa7518c16b1482b87aa72990193cafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.319218 5534 tablet_service.cc:1467] Processing CreateTablet for tablet 5aa7518c16b1482b87aa72990193cafd (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 13:32:38.320492 5534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5aa7518c16b1482b87aa72990193cafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.320634 5529 tablet_service.cc:1467] Processing CreateTablet for tablet fc6f41d0f11d4c6295bae40c23631a4a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 13:32:38.321939 5529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc6f41d0f11d4c6295bae40c23631a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.323163 5532 tablet_service.cc:1467] Processing CreateTablet for tablet b3566608e8e74f10a291207e9cb298b8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 13:32:38.323980 5649 tablet_service.cc:1467] Processing CreateTablet for tablet 93d548887d4245c7b22072e49517a84f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 13:32:38.325264 5649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93d548887d4245c7b22072e49517a84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.325379 5531 tablet_service.cc:1467] Processing CreateTablet for tablet 93d548887d4245c7b22072e49517a84f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 13:32:38.325976 5648 tablet_service.cc:1467] Processing CreateTablet for tablet f9bb2629a0e741fbb67f5b64ab12e4d8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 13:32:38.327265 5648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9bb2629a0e741fbb67f5b64ab12e4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.327247 5647 tablet_service.cc:1467] Processing CreateTablet for tablet fc6f41d0f11d4c6295bae40c23631a4a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 13:32:38.328559 5647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc6f41d0f11d4c6295bae40c23631a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.331254 5646 tablet_service.cc:1467] Processing CreateTablet for tablet a7313c1813bc4e61a0c26ee5661f0a18 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 13:32:38.332527 5646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7313c1813bc4e61a0c26ee5661f0a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.335316 5645 tablet_service.cc:1467] Processing CreateTablet for tablet f3bf6b4114cb4a07b86da2385fa903bc (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 13:32:38.336580 5645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3bf6b4114cb4a07b86da2385fa903bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.339753 5527 tablet_service.cc:1467] Processing CreateTablet for tablet a7313c1813bc4e61a0c26ee5661f0a18 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 13:32:38.342413 5525 tablet_service.cc:1467] Processing CreateTablet for tablet f3bf6b4114cb4a07b86da2385fa903bc (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 13:32:38.350550 5532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3566608e8e74f10a291207e9cb298b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.354429 5525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3bf6b4114cb4a07b86da2385fa903bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.358410 5527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7313c1813bc4e61a0c26ee5661f0a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.389956 5531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93d548887d4245c7b22072e49517a84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.397967 5652 tablet_service.cc:1467] Processing CreateTablet for tablet 641931ccce1e4d71a725d4278f4306a1 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 13:32:38.399288 5652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 641931ccce1e4d71a725d4278f4306a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.404726 5535 tablet_service.cc:1467] Processing CreateTablet for tablet 1040b0fd2a864acfbcba9c911244963f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 13:32:38.414651 5747 tablet_service.cc:1467] Processing CreateTablet for tablet f9bb2629a0e741fbb67f5b64ab12e4d8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 13:32:38.416066 5747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9bb2629a0e741fbb67f5b64ab12e4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.416643 5654 tablet_service.cc:1467] Processing CreateTablet for tablet e7704ce89ae2457b9b1adf72a86591a4 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 13:32:38.417865 5654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7704ce89ae2457b9b1adf72a86591a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.424954 5746 tablet_service.cc:1467] Processing CreateTablet for tablet fc6f41d0f11d4c6295bae40c23631a4a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 13:32:38.404927 5760 tablet_service.cc:1467] Processing CreateTablet for tablet 37b9562e68354bc69b54b07a09406578 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 13:32:38.405421 5653 tablet_service.cc:1467] Processing CreateTablet for tablet d5784def40b1487a966773a9c9a8d508 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 13:32:38.406543 5759 tablet_service.cc:1467] Processing CreateTablet for tablet dc4a6a8da3ec47dc859ce24a3852828d (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 13:32:38.408181 5758 tablet_service.cc:1467] Processing CreateTablet for tablet 507708159cfa4a0885418e218939cd02 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 13:32:38.436223 5537 tablet_service.cc:1467] Processing CreateTablet for tablet d5784def40b1487a966773a9c9a8d508 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 13:32:38.412842 5751 tablet_service.cc:1467] Processing CreateTablet for tablet 93d548887d4245c7b22072e49517a84f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 13:32:38.409852 5757 tablet_service.cc:1467] Processing CreateTablet for tablet 5aa7518c16b1482b87aa72990193cafd (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 13:32:38.435865 5527 tablet_service.cc:1467] Processing CreateTablet for tablet 641931ccce1e4d71a725d4278f4306a1 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 13:32:38.435984 5743 tablet_service.cc:1467] Processing CreateTablet for tablet f3bf6b4114cb4a07b86da2385fa903bc (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 13:32:38.433874 5744 tablet_service.cc:1467] Processing CreateTablet for tablet a7313c1813bc4e61a0c26ee5661f0a18 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 13:32:38.436789 5746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc6f41d0f11d4c6295bae40c23631a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.411222 5756 tablet_service.cc:1467] Processing CreateTablet for tablet b3566608e8e74f10a291207e9cb298b8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 13:32:38.416066 5535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1040b0fd2a864acfbcba9c911244963f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.441285 5758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 507708159cfa4a0885418e218939cd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.455808 5534 tablet_service.cc:1467] Processing CreateTablet for tablet e7704ce89ae2457b9b1adf72a86591a4 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 13:32:38.463146 5532 tablet_service.cc:1467] Processing CreateTablet for tablet 5d8130b8a41d445a89847207cfa96bfe (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 13:32:38.465684 5529 tablet_service.cc:1467] Processing CreateTablet for tablet 2f04480445ab4d6fa33d8835e8337f0c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 13:32:38.470698 5647 tablet_service.cc:1467] Processing CreateTablet for tablet 2f04480445ab4d6fa33d8835e8337f0c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 13:32:38.473521 5759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc4a6a8da3ec47dc859ce24a3852828d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.474323 5760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37b9562e68354bc69b54b07a09406578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.475255 5743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3bf6b4114cb4a07b86da2385fa903bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.478440 5756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3566608e8e74f10a291207e9cb298b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.482496 5537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5784def40b1487a966773a9c9a8d508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.473265 5653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5784def40b1487a966773a9c9a8d508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.489364 5647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f04480445ab4d6fa33d8835e8337f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.493166 5751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93d548887d4245c7b22072e49517a84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.494431 5757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5aa7518c16b1482b87aa72990193cafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.498402 5744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7313c1813bc4e61a0c26ee5661f0a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.498361 5646 tablet_service.cc:1467] Processing CreateTablet for tablet 5d8130b8a41d445a89847207cfa96bfe (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 13:32:38.499670 5646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d8130b8a41d445a89847207cfa96bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.394354 5648 tablet_service.cc:1467] Processing CreateTablet for tablet 1040b0fd2a864acfbcba9c911244963f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 13:32:38.502329 5534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7704ce89ae2457b9b1adf72a86591a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.502869 5648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1040b0fd2a864acfbcba9c911244963f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.506809 5827 tablet_bootstrap.cc:492] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:38.507179 5532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d8130b8a41d445a89847207cfa96bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.510149 5529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f04480445ab4d6fa33d8835e8337f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.511049 5541 tablet_service.cc:1467] Processing CreateTablet for tablet ad0be1172a5341228befdfb4f3a40efd (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 13:32:38.531662 5758 tablet_service.cc:1467] Processing CreateTablet for tablet 1040b0fd2a864acfbcba9c911244963f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 13:32:38.533056 5758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1040b0fd2a864acfbcba9c911244963f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.538321 5527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 641931ccce1e4d71a725d4278f4306a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.544965 5645 tablet_service.cc:1467] Processing CreateTablet for tablet ad0be1172a5341228befdfb4f3a40efd (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 13:32:38.549787 5828 tablet_bootstrap.cc:492] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:38.552104 5525 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0808d0c45840eb9b05a49a18515c90 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 13:32:38.553512 5525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0808d0c45840eb9b05a49a18515c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.555577 5651 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0808d0c45840eb9b05a49a18515c90 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 13:32:38.562003 5649 tablet_service.cc:1467] Processing CreateTablet for tablet de691af34db140198cfa9694fdc8ce3f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 13:32:38.563781 5743 tablet_service.cc:1467] Processing CreateTablet for tablet 641931ccce1e4d71a725d4278f4306a1 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 13:32:38.571437 5746 tablet_service.cc:1467] Processing CreateTablet for tablet d5784def40b1487a966773a9c9a8d508 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 13:32:38.579062 5537 tablet_service.cc:1467] Processing CreateTablet for tablet de691af34db140198cfa9694fdc8ce3f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 13:32:38.579298 5647 tablet_service.cc:1467] Processing CreateTablet for tablet d8088f9cbecf4cf59a35c5f15ba5490d (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 13:32:38.579408 5757 tablet_service.cc:1467] Processing CreateTablet for tablet e7704ce89ae2457b9b1adf72a86591a4 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 13:32:38.580348 5530 tablet_service.cc:1467] Processing CreateTablet for tablet d8088f9cbecf4cf59a35c5f15ba5490d (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 13:32:38.592353 5645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad0be1172a5341228befdfb4f3a40efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.613970 5651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0808d0c45840eb9b05a49a18515c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.615016 5647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8088f9cbecf4cf59a35c5f15ba5490d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.614976 5532 tablet_service.cc:1467] Processing CreateTablet for tablet 9a473fdcfed54f57b127f9f85d46c8ea (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 13:32:38.620007 5828 tablet_bootstrap.cc:654] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:38.621465 5652 tablet_service.cc:1467] Processing CreateTablet for tablet 9a473fdcfed54f57b127f9f85d46c8ea (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 13:32:38.622215 5541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad0be1172a5341228befdfb4f3a40efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.622434 5649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de691af34db140198cfa9694fdc8ce3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.622814 5530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8088f9cbecf4cf59a35c5f15ba5490d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.601814 5751 tablet_service.cc:1467] Processing CreateTablet for tablet 5d8130b8a41d445a89847207cfa96bfe (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 13:32:38.624663 5532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a473fdcfed54f57b127f9f85d46c8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.618615 5758 tablet_service.cc:1467] Processing CreateTablet for tablet 2f04480445ab4d6fa33d8835e8337f0c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 13:32:38.632479 5653 tablet_service.cc:1467] Processing CreateTablet for tablet 1b3376f59e7e4a14ab419b67f1758cd9 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 13:32:38.633148 5747 tablet_service.cc:1467] Processing CreateTablet for tablet ad0be1172a5341228befdfb4f3a40efd (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 13:32:38.647893 5535 tablet_service.cc:1467] Processing CreateTablet for tablet 1b3376f59e7e4a14ab419b67f1758cd9 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 13:32:38.651403 5830 tablet_bootstrap.cc:492] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:38.658597 5537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de691af34db140198cfa9694fdc8ce3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.663121 5535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b3376f59e7e4a14ab419b67f1758cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.647938 5655 tablet_service.cc:1467] Processing CreateTablet for tablet 35f1738bc8ae4372b7379be9ce23052e (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 13:32:38.633749 5653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b3376f59e7e4a14ab419b67f1758cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.606719 5743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 641931ccce1e4d71a725d4278f4306a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.682643 5652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a473fdcfed54f57b127f9f85d46c8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.611693 5827 tablet_bootstrap.cc:654] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:38.683218 5747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad0be1172a5341228befdfb4f3a40efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.684382 5828 tablet_bootstrap.cc:492] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:38.684906 5828 ts_tablet_manager.cc:1397] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.136s user 0.006s sys 0.008s
I20260807 13:32:38.687731 5828 raft_consensus.cc:348] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:38.688540 5828 raft_consensus.cc:374] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:38.688869 5828 raft_consensus.cc:729] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:38.638796 5759 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0808d0c45840eb9b05a49a18515c90 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 13:32:38.690397 5751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d8130b8a41d445a89847207cfa96bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.690999 5759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0808d0c45840eb9b05a49a18515c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.689682 5828 consensus_queue.cc:260] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:38.691576 5746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5784def40b1487a966773a9c9a8d508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.712925 5654 tablet_service.cc:1467] Processing CreateTablet for tablet 601f17ec93374792b153deacf070cc16 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 13:32:38.714346 5758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f04480445ab4d6fa33d8835e8337f0c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:32:38.694972 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:38.694654 5760 tablet_service.cc:1467] Processing CreateTablet for tablet de691af34db140198cfa9694fdc8ce3f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 13:32:38.696048 5534 tablet_service.cc:1467] Processing CreateTablet for tablet 601f17ec93374792b153deacf070cc16 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 13:32:38.696832 5655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f1738bc8ae4372b7379be9ce23052e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.719800 5541 tablet_service.cc:1467] Processing CreateTablet for tablet fe15514c51394171aa6a89ece7b59617 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 13:32:38.720877 5760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de691af34db140198cfa9694fdc8ce3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.722534 5744 tablet_service.cc:1467] Processing CreateTablet for tablet 9a473fdcfed54f57b127f9f85d46c8ea (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 13:32:38.723703 5744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a473fdcfed54f57b127f9f85d46c8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.726895 5757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7704ce89ae2457b9b1adf72a86591a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.731834 5756 tablet_service.cc:1467] Processing CreateTablet for tablet d8088f9cbecf4cf59a35c5f15ba5490d (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 13:32:38.734118 5530 tablet_service.cc:1467] Processing CreateTablet for tablet 41befa481a284977a33f2f54ba55af62 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 13:32:38.736442 5654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601f17ec93374792b153deacf070cc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.740358 5646 tablet_service.cc:1467] Processing CreateTablet for tablet 41befa481a284977a33f2f54ba55af62 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 13:32:38.741500 5646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41befa481a284977a33f2f54ba55af62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.742977 5648 tablet_service.cc:1467] Processing CreateTablet for tablet 92946d3f971149ddbb9f81496d989dde (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 13:32:38.744129 5648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92946d3f971149ddbb9f81496d989dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.714231 5527 tablet_service.cc:1467] Processing CreateTablet for tablet 2c697ab25e4448969fc7491db2de779a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 13:32:38.748806 5647 tablet_service.cc:1467] Processing CreateTablet for tablet 4a88f0c0fb0248fda509c04043a6ceb5 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 13:32:38.749958 5647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a88f0c0fb0248fda509c04043a6ceb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.703770 5532 tablet_service.cc:1467] Processing CreateTablet for tablet 35f1738bc8ae4372b7379be9ce23052e (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 13:32:38.704056 5529 tablet_service.cc:1467] Processing CreateTablet for tablet e1f11d721d314b9897773816faaa3205 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 13:32:38.707131 5651 tablet_service.cc:1467] Processing CreateTablet for tablet e1f11d721d314b9897773816faaa3205 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 13:32:38.707803 5531 tablet_service.cc:1467] Processing CreateTablet for tablet 92946d3f971149ddbb9f81496d989dde (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 13:32:38.712374 5649 tablet_service.cc:1467] Processing CreateTablet for tablet fe15514c51394171aa6a89ece7b59617 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 13:32:38.693243 5830 tablet_bootstrap.cc:654] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:38.720966 5541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe15514c51394171aa6a89ece7b59617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.755734 5534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601f17ec93374792b153deacf070cc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.756377 5525 tablet_service.cc:1467] Processing CreateTablet for tablet 4a88f0c0fb0248fda509c04043a6ceb5 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 13:32:38.759270 5651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1f11d721d314b9897773816faaa3205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.759315 5531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92946d3f971149ddbb9f81496d989dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.762959 5743 tablet_service.cc:1467] Processing CreateTablet for tablet 1b3376f59e7e4a14ab419b67f1758cd9 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 13:32:38.763428 5828 ts_tablet_manager.cc:1428] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.078s user 0.004s sys 0.004s
I20260807 13:32:38.759366 5645 tablet_service.cc:1467] Processing CreateTablet for tablet 2c697ab25e4448969fc7491db2de779a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 13:32:38.764246 5703 heartbeater.cc:503] Master 127.3.187.254:34519 was elected leader, sending a full tablet report...
I20260807 13:32:38.764982 5828 tablet_bootstrap.cc:492] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:38.752945 5652 tablet_service.cc:1467] Processing CreateTablet for tablet e5ae9ad6f573417ea9bbab82087da0d6 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 13:32:38.767094 5756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8088f9cbecf4cf59a35c5f15ba5490d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.774924 5649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe15514c51394171aa6a89ece7b59617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.776656 5743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b3376f59e7e4a14ab419b67f1758cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.776932 5537 tablet_service.cc:1467] Processing CreateTablet for tablet e5ae9ad6f573417ea9bbab82087da0d6 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 13:32:38.781119 5652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5ae9ad6f573417ea9bbab82087da0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.785966 5527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c697ab25e4448969fc7491db2de779a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.793111 5530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41befa481a284977a33f2f54ba55af62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.794283 5827 tablet_bootstrap.cc:492] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:38.794735 5827 ts_tablet_manager.cc:1397] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.288s user 0.012s sys 0.009s
I20260807 13:32:38.797691 5827 raft_consensus.cc:348] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:38.798429 5827 raft_consensus.cc:374] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:38.798527 5529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1f11d721d314b9897773816faaa3205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.798743 5827 raft_consensus.cc:729] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:38.799567 5827 consensus_queue.cc:260] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:38.800585 5532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f1738bc8ae4372b7379be9ce23052e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.802660 5525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a88f0c0fb0248fda509c04043a6ceb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.805063 5645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c697ab25e4448969fc7491db2de779a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.816761 5537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5ae9ad6f573417ea9bbab82087da0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.838423 5828 tablet_bootstrap.cc:654] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:38.840759 5744 tablet_service.cc:1467] Processing CreateTablet for tablet 601f17ec93374792b153deacf070cc16 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 13:32:38.850939 5744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601f17ec93374792b153deacf070cc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.842891 5830 tablet_bootstrap.cc:492] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:38.854429 5830 ts_tablet_manager.cc:1397] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.203s user 0.013s sys 0.016s
I20260807 13:32:38.855055 5746 tablet_service.cc:1467] Processing CreateTablet for tablet 35f1738bc8ae4372b7379be9ce23052e (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 13:32:38.856427 5746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f1738bc8ae4372b7379be9ce23052e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.857079 5830 raft_consensus.cc:348] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:38.857851 5830 raft_consensus.cc:374] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:38.825531 5535 tablet_service.cc:1467] Processing CreateTablet for tablet 5f4a8b1973984ea99cbc92ff5ba63770 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 13:32:38.860423 5747 tablet_service.cc:1467] Processing CreateTablet for tablet 92946d3f971149ddbb9f81496d989dde (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 13:32:38.860988 5654 tablet_service.cc:1467] Processing CreateTablet for tablet e25f5d92529949cb904fde2d44bd715a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 13:32:38.867776 5535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f4a8b1973984ea99cbc92ff5ba63770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.874657 5655 tablet_service.cc:1467] Processing CreateTablet for tablet 5f4a8b1973984ea99cbc92ff5ba63770 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 13:32:38.875944 5655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f4a8b1973984ea99cbc92ff5ba63770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.879987 5758 tablet_service.cc:1467] Processing CreateTablet for tablet 2c697ab25e4448969fc7491db2de779a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 13:32:38.881935 5654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25f5d92529949cb904fde2d44bd715a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.885046 5534 tablet_service.cc:1467] Processing CreateTablet for tablet e25f5d92529949cb904fde2d44bd715a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 13:32:38.886802 5596 heartbeater.cc:503] Master 127.3.187.254:34519 was elected leader, sending a full tablet report...
I20260807 13:32:38.870862 5757 tablet_service.cc:1467] Processing CreateTablet for tablet e1f11d721d314b9897773816faaa3205 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 13:32:38.865063 5830 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:38.889487 5830 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:38.873142 5747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92946d3f971149ddbb9f81496d989dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.893793 5827 ts_tablet_manager.cc:1428] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.099s user 0.013s sys 0.029s
I20260807 13:32:38.894773 5827 tablet_bootstrap.cc:492] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:38.896688 5760 tablet_service.cc:1467] Processing CreateTablet for tablet fe15514c51394171aa6a89ece7b59617 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 13:32:38.902522 5758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c697ab25e4448969fc7491db2de779a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.898921 5653 tablet_service.cc:1467] Processing CreateTablet for tablet e0724fe2430d41e588c520b9a8228cb4 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 13:32:38.911276 5534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25f5d92529949cb904fde2d44bd715a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.912539 5759 tablet_service.cc:1467] Processing CreateTablet for tablet 4a88f0c0fb0248fda509c04043a6ceb5 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 13:32:38.913981 5537 tablet_service.cc:1467] Processing CreateTablet for tablet 9675aa173f334c5f870358069a6e68f4 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 13:32:38.915280 5537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9675aa173f334c5f870358069a6e68f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.931120 5653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0724fe2430d41e588c520b9a8228cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.940629 5537 tablet_service.cc:1467] Processing CreateTablet for tablet a026eb38cd9747c89f7d1b5ba508dfe8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 13:32:38.941183 5651 tablet_service.cc:1467] Processing CreateTablet for tablet a026eb38cd9747c89f7d1b5ba508dfe8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 13:32:38.942615 5537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a026eb38cd9747c89f7d1b5ba508dfe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.943114 5760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe15514c51394171aa6a89ece7b59617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.943815 5757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1f11d721d314b9897773816faaa3205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.945032 5830 ts_tablet_manager.cc:1428] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.090s user 0.004s sys 0.009s
I20260807 13:32:38.945726 5759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a88f0c0fb0248fda509c04043a6ceb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.953059 5535 tablet_service.cc:1467] Processing CreateTablet for tablet 03cc5aef20f549689e8b1ba7db0effed (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 13:32:38.955931 5828 tablet_bootstrap.cc:492] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:38.963377 5828 ts_tablet_manager.cc:1397] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.199s user 0.014s sys 0.000s
I20260807 13:32:38.873165 5649 tablet_service.cc:1467] Processing CreateTablet for tablet 9675aa173f334c5f870358069a6e68f4 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 13:32:38.966485 5830 tablet_bootstrap.cc:492] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:38.966078 5828 raft_consensus.cc:348] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:38.966833 5828 raft_consensus.cc:374] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:38.967128 5828 raft_consensus.cc:729] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:38.967499 5751 tablet_service.cc:1467] Processing CreateTablet for tablet e5ae9ad6f573417ea9bbab82087da0d6 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 13:32:38.958433 5651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a026eb38cd9747c89f7d1b5ba508dfe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.958945 5807 heartbeater.cc:503] Master 127.3.187.254:34519 was elected leader, sending a full tablet report...
I20260807 13:32:38.970338 5655 tablet_service.cc:1467] Processing CreateTablet for tablet 5fee77ea2bf842b780a8cbcaf0698bc3 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 13:32:38.970443 5756 tablet_service.cc:1467] Processing CreateTablet for tablet 41befa481a284977a33f2f54ba55af62 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 13:32:38.969081 5648 tablet_service.cc:1467] Processing CreateTablet for tablet 03cc5aef20f549689e8b1ba7db0effed (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 13:32:38.957226 5537 tablet_service.cc:1467] Processing CreateTablet for tablet 5fee77ea2bf842b780a8cbcaf0698bc3 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 13:32:38.972967 5537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fee77ea2bf842b780a8cbcaf0698bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.973707 5649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9675aa173f334c5f870358069a6e68f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.970808 5751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5ae9ad6f573417ea9bbab82087da0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.967916 5828 consensus_queue.cc:260] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:38.974340 5655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fee77ea2bf842b780a8cbcaf0698bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.976197 5535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03cc5aef20f549689e8b1ba7db0effed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.978252 5648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03cc5aef20f549689e8b1ba7db0effed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:38.988837 5756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41befa481a284977a33f2f54ba55af62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.003945 5827 tablet_bootstrap.cc:654] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:39.012887 5525 tablet_service.cc:1467] Processing CreateTablet for tablet f9a2a18897a34e30b068d5cbe66cc197 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:32:39.014122 5647 tablet_service.cc:1467] Processing CreateTablet for tablet f9a2a18897a34e30b068d5cbe66cc197 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:32:39.014771 5828 ts_tablet_manager.cc:1428] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.051s user 0.002s sys 0.010s
I20260807 13:32:39.016327 5835 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:39.056638 5835 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.059079 5835 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:39.029735 5541 tablet_service.cc:1467] Processing CreateTablet for tablet fc56ae27721c4c918c12ed9b14dc2950 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 13:32:39.069319 5747 tablet_service.cc:1467] Processing CreateTablet for tablet e25f5d92529949cb904fde2d44bd715a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 13:32:39.070533 5747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25f5d92529949cb904fde2d44bd715a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.070925 5760 tablet_service.cc:1467] Processing CreateTablet for tablet 9675aa173f334c5f870358069a6e68f4 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 13:32:39.072141 5760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9675aa173f334c5f870358069a6e68f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.074596 5751 tablet_service.cc:1467] Processing CreateTablet for tablet e0724fe2430d41e588c520b9a8228cb4 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 13:32:39.075791 5751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0724fe2430d41e588c520b9a8228cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.076363 5759 tablet_service.cc:1467] Processing CreateTablet for tablet a026eb38cd9747c89f7d1b5ba508dfe8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 13:32:39.077770 5759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a026eb38cd9747c89f7d1b5ba508dfe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.073391 5537 tablet_service.cc:1467] Processing CreateTablet for tablet 58893d6e4d174e17a32138854a565d6c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:32:39.083124 5828 tablet_bootstrap.cc:492] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:39.083006 5529 tablet_service.cc:1467] Processing CreateTablet for tablet 34cf6d5926a945c3bcae21611f9b8dbe (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:32:39.085435 5653 tablet_service.cc:1467] Processing CreateTablet for tablet 58893d6e4d174e17a32138854a565d6c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:32:39.086812 5653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58893d6e4d174e17a32138854a565d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.039726 5527 tablet_service.cc:1467] Processing CreateTablet for tablet e0724fe2430d41e588c520b9a8228cb4 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 13:32:39.041939 5525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9a2a18897a34e30b068d5cbe66cc197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.093797 5541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc56ae27721c4c918c12ed9b14dc2950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.094772 5527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0724fe2430d41e588c520b9a8228cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.095734 5537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58893d6e4d174e17a32138854a565d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.043112 5652 tablet_service.cc:1467] Processing CreateTablet for tablet fc56ae27721c4c918c12ed9b14dc2950 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 13:32:39.049943 5531 tablet_service.cc:1467] Processing CreateTablet for tablet c61e1dd5b00c43d2a1747f4832ac333c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 13:32:39.097594 5531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c61e1dd5b00c43d2a1747f4832ac333c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.098959 5743 tablet_service.cc:1467] Processing CreateTablet for tablet 03cc5aef20f549689e8b1ba7db0effed (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 13:32:39.052459 5757 tablet_service.cc:1467] Processing CreateTablet for tablet 5f4a8b1973984ea99cbc92ff5ba63770 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 13:32:39.055022 5830 tablet_bootstrap.cc:654] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:39.102756 5530 tablet_service.cc:1467] Processing CreateTablet for tablet 9417f147a78e41728d00594b19828f18 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 13:32:39.104130 5652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc56ae27721c4c918c12ed9b14dc2950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.117410 5532 tablet_service.cc:1467] Processing CreateTablet for tablet fe27c759c1d64d15b7854094a751aa1a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:32:39.118432 5757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f4a8b1973984ea99cbc92ff5ba63770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.055711 5648 tablet_service.cc:1467] Processing CreateTablet for tablet c61e1dd5b00c43d2a1747f4832ac333c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 13:32:39.136561 5760 tablet_service.cc:1467] Processing CreateTablet for tablet 5fee77ea2bf842b780a8cbcaf0698bc3 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 13:32:39.139375 5744 tablet_service.cc:1467] Processing CreateTablet for tablet f9a2a18897a34e30b068d5cbe66cc197 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 13:32:39.144819 5746 tablet_service.cc:1467] Processing CreateTablet for tablet fc56ae27721c4c918c12ed9b14dc2950 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 13:32:39.145707 5648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c61e1dd5b00c43d2a1747f4832ac333c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.146610 5647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9a2a18897a34e30b068d5cbe66cc197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.147169 5743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03cc5aef20f549689e8b1ba7db0effed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.147112 5756 tablet_service.cc:1467] Processing CreateTablet for tablet c61e1dd5b00c43d2a1747f4832ac333c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 13:32:39.147840 5654 tablet_service.cc:1467] Processing CreateTablet for tablet 34cf6d5926a945c3bcae21611f9b8dbe (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:32:39.148437 5756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c61e1dd5b00c43d2a1747f4832ac333c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.149034 5654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34cf6d5926a945c3bcae21611f9b8dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.151110 5760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fee77ea2bf842b780a8cbcaf0698bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.151938 5655 tablet_service.cc:1467] Processing CreateTablet for tablet 9417f147a78e41728d00594b19828f18 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 13:32:39.156030 5646 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae537112be24f77ab71856bb03006ce (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:32:39.136883 5530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9417f147a78e41728d00594b19828f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.157187 5535 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1250a61f1842c192fd95f3a267926f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 13:32:39.157282 5645 tablet_service.cc:1467] Processing CreateTablet for tablet fe27c759c1d64d15b7854094a751aa1a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:32:39.158582 5529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34cf6d5926a945c3bcae21611f9b8dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.136144 5534 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae537112be24f77ab71856bb03006ce (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:32:39.159538 5534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae537112be24f77ab71856bb03006ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.159816 5828 tablet_bootstrap.cc:654] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:39.162379 5744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9a2a18897a34e30b068d5cbe66cc197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.156140 5651 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1250a61f1842c192fd95f3a267926f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 13:32:39.171082 5646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae537112be24f77ab71856bb03006ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.185317 5830 tablet_bootstrap.cc:492] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:39.185869 5830 ts_tablet_manager.cc:1397] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.220s user 0.015s sys 0.007s
I20260807 13:32:39.180603 5532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe27c759c1d64d15b7854094a751aa1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.180688 5746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc56ae27721c4c918c12ed9b14dc2950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.185387 5757 tablet_service.cc:1467] Processing CreateTablet for tablet 58893d6e4d174e17a32138854a565d6c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 13:32:39.193979 5837 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:39.195277 5837 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.197933 5837 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:39.198382 5535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1250a61f1842c192fd95f3a267926f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.198653 5835 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:39.199102 5835 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.188591 5655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9417f147a78e41728d00594b19828f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.203603 5835 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:39.221021 5649 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7c63e776384e4191d85c1a670fcb60 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:32:39.221168 5758 tablet_service.cc:1467] Processing CreateTablet for tablet fe27c759c1d64d15b7854094a751aa1a (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 13:32:39.201467 5759 tablet_service.cc:1467] Processing CreateTablet for tablet 34cf6d5926a945c3bcae21611f9b8dbe (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 13:32:39.224874 5531 tablet_service.cc:1467] Processing CreateTablet for tablet 7750cee5180c40cd9177e29f5d41bce8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:32:39.204263 5747 tablet_service.cc:1467] Processing CreateTablet for tablet 9417f147a78e41728d00594b19828f18 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 13:32:39.226059 5531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7750cee5180c40cd9177e29f5d41bce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.230239 5757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58893d6e4d174e17a32138854a565d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.188669 5541 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7c63e776384e4191d85c1a670fcb60 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:32:39.231447 5830 raft_consensus.cc:348] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.250670 5830 raft_consensus.cc:374] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:39.250953 5830 raft_consensus.cc:729] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:39.251822 5827 tablet_bootstrap.cc:492] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:39.251639 5830 consensus_queue.cc:260] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.252251 5827 ts_tablet_manager.cc:1397] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.358s user 0.005s sys 0.007s
I20260807 13:32:39.253734 5830 ts_tablet_manager.cc:1428] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.068s user 0.007s sys 0.000s
I20260807 13:32:39.247798 5651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1250a61f1842c192fd95f3a267926f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.262686 5830 tablet_bootstrap.cc:492] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:39.264073 5839 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:39.269951 5648 tablet_service.cc:1467] Processing CreateTablet for tablet 7750cee5180c40cd9177e29f5d41bce8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:32:39.280375 5839 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.283787 5839 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:39.289281 5758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe27c759c1d64d15b7854094a751aa1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.300575 5827 raft_consensus.cc:348] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.306032 5827 raft_consensus.cc:374] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:39.306351 5827 raft_consensus.cc:729] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:39.307082 5827 consensus_queue.cc:260] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.311663 5530 tablet_service.cc:1467] Processing CreateTablet for tablet 99c4182493ae4faa8085c4f332f8c07d (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:32:39.271365 5751 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae537112be24f77ab71856bb03006ce (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 13:32:39.314122 5532 tablet_service.cc:1467] Processing CreateTablet for tablet 83c1aab638794d7b89a5e2344158d7c0 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:32:39.316355 5827 ts_tablet_manager.cc:1428] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.064s user 0.005s sys 0.004s
I20260807 13:32:39.299427 5541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7c63e776384e4191d85c1a670fcb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.317610 5645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe27c759c1d64d15b7854094a751aa1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.343031 5759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34cf6d5926a945c3bcae21611f9b8dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.347317 5649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7c63e776384e4191d85c1a670fcb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.346973 5530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99c4182493ae4faa8085c4f332f8c07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.330655 5743 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1250a61f1842c192fd95f3a267926f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 13:32:39.343528 5827 tablet_bootstrap.cc:492] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:39.354535 5654 tablet_service.cc:1467] Processing CreateTablet for tablet 99c4182493ae4faa8085c4f332f8c07d (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:32:39.366900 5828 tablet_bootstrap.cc:492] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:39.367408 5828 ts_tablet_manager.cc:1397] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.284s user 0.021s sys 0.024s
I20260807 13:32:39.379763 5532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83c1aab638794d7b89a5e2344158d7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.395246 5653 tablet_service.cc:1467] Processing CreateTablet for tablet 83c1aab638794d7b89a5e2344158d7c0 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:32:39.396737 5653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83c1aab638794d7b89a5e2344158d7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.370074 5828 raft_consensus.cc:348] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.402297 5828 raft_consensus.cc:374] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:39.402818 5828 raft_consensus.cc:729] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:39.403649 5828 consensus_queue.cc:260] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.406159 5828 ts_tablet_manager.cc:1428] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.038s user 0.003s sys 0.004s
I20260807 13:32:39.407603 5646 tablet_service.cc:1467] Processing CreateTablet for tablet 3855b3f3c6494a5491ce30bfc4b34d14 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:32:39.382262 5534 tablet_service.cc:1467] Processing CreateTablet for tablet 3855b3f3c6494a5491ce30bfc4b34d14 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:32:39.583356 5534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3855b3f3c6494a5491ce30bfc4b34d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.419330 5751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae537112be24f77ab71856bb03006ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.438732 5760 tablet_service.cc:1467] Processing CreateTablet for tablet 7750cee5180c40cd9177e29f5d41bce8 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 13:32:39.477339 5529 tablet_service.cc:1467] Processing CreateTablet for tablet e23c0bda4b9045029b855a13c38aadb7 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:32:39.677239 5760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7750cee5180c40cd9177e29f5d41bce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.677312 5529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e23c0bda4b9045029b855a13c38aadb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.562587 5525 tablet_service.cc:1467] Processing CreateTablet for tablet 94e7bc4ef4d34614b8ba037cb437058c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:32:39.437732 5827 tablet_bootstrap.cc:654] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:39.421096 5828 tablet_bootstrap.cc:492] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:39.716137 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:39.595088 5756 tablet_service.cc:1467] Processing CreateTablet for tablet 99c4182493ae4faa8085c4f332f8c07d (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 13:32:39.717461 5757 tablet_service.cc:1467] Processing CreateTablet for tablet 3855b3f3c6494a5491ce30bfc4b34d14 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 13:32:39.595088 5531 tablet_service.cc:1467] Processing CreateTablet for tablet 99f11806ff494d788e869d5368f88f3b (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:32:39.595398 5537 tablet_service.cc:1467] Processing CreateTablet for tablet abe57eac6430478584bb4e98bfff100f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:32:39.601903 5530 tablet_service.cc:1467] Processing CreateTablet for tablet 865420f31e38417a929d1a0f5c2009ac (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:32:39.601415 5534 tablet_service.cc:1467] Processing CreateTablet for tablet b950598d88564a8a85e1489e7f9843cb (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:32:39.629557 5532 tablet_service.cc:1467] Processing CreateTablet for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:32:39.631273 5653 tablet_service.cc:1467] Processing CreateTablet for tablet e23c0bda4b9045029b855a13c38aadb7 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:32:39.638713 5655 tablet_service.cc:1467] Processing CreateTablet for tablet 94e7bc4ef4d34614b8ba037cb437058c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:32:39.641685 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:39.652601 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:39.659703 5651 tablet_service.cc:1467] Processing CreateTablet for tablet abe57eac6430478584bb4e98bfff100f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 13:32:39.681385 5525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e7bc4ef4d34614b8ba037cb437058c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.721468 5532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.682672 5652 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52568 (request call id 39) took 1002 ms. Trace:
W20260807 13:32:39.721755 5499 leader_election.cc:341] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.683429 5839 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:39.722321 5839 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.724265 5839 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:39.684722 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:39.685835 5837 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:39.726395 5534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b950598d88564a8a85e1489e7f9843cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.726154 5837 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.727022 5530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 865420f31e38417a929d1a0f5c2009ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.728053 5837 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:39.687193 5743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1250a61f1842c192fd95f3a267926f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.730394 5537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abe57eac6430478584bb4e98bfff100f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:32:39.731280 5620 leader_election.cc:341] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.691182 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:39.732465 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:39.695348 5647 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52568 (request call id 38) took 1037 ms. Trace:
I20260807 13:32:39.734213 5647 rpcz_store.cc:276] 0807 13:32:38.658054 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.013223 (+355169us) service_pool.cc:227] Handling call
0807 13:32:39.146212 (+132989us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.146294 (+ 82us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.383430 (+237136us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.694826 (+311396us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.695293 (+ 467us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:39.721904 5652 rpcz_store.cc:276] 0807 13:32:38.679970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.042272 (+362302us) service_pool.cc:227] Handling call
0807 13:32:39.103187 (+ 60915us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.103464 (+ 277us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.232320 (+128856us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.420029 (+187709us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.682326 (+262297us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416e82 00007ff68832f8b9 00007ff6872425d8 00007ff687306063 00007ff687301e2f 00007ff6873025ed 00007ff6872b3869 00007ff6808b5c44 00007ff6808b5bd2
0807 13:32:39.682617 (+ 291us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":381983488}
I20260807 13:32:39.736405 5647 tablet_service.cc:1467] Processing CreateTablet for tablet b950598d88564a8a85e1489e7f9843cb (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:32:39.697286 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:39.737119 5652 tablet_service.cc:1467] Processing CreateTablet for tablet 865420f31e38417a929d1a0f5c2009ac (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260807 13:32:39.738641 5722 leader_election.cc:341] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.738715 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:39.739118 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:39.739362 5771 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:39.739786 5747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9417f147a78e41728d00594b19828f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.740396 5531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99f11806ff494d788e869d5368f88f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.698406 5649 tablet_service.cc:1467] Processing CreateTablet for tablet 99f11806ff494d788e869d5368f88f3b (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:32:39.699438 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:39.743415 5499 leader_election.cc:341] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.744131 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:39.744735 5555 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:39.748008 5501 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:39.749272 5722 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:39.752038 5837 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:39.752442 5837 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:39.752779 5837 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:39.754492 5839 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:39.699294 5760 tablet_service.cc:1467] Processing CreateTablet for tablet 83c1aab638794d7b89a5e2344158d7c0 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 13:32:39.701226 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:39.702674 5648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7750cee5180c40cd9177e29f5d41bce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.760596 5652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 865420f31e38417a929d1a0f5c2009ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.709293 5527 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54374 (request call id 34) took 1121 ms. Trace:
I20260807 13:32:39.710412 5835 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:32:39.766499 5501 leader_election.cc:341] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.766964 5501 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:32:39.717773 5618 leader_election.cc:341] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:39.767614 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 50012.8us
I20260807 13:32:39.766525 5527 rpcz_store.cc:276] 0807 13:32:38.588323 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:38.925892 (+337569us) service_pool.cc:227] Handling call
0807 13:32:39.094330 (+168438us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.094425 (+ 95us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.192367 (+ 97942us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.708785 (+516418us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.709238 (+ 453us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:32:39.769254 5618 leader_election.cc:341] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:39.769279 5721 leader_election.cc:341] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:39.770156 5620 leader_election.cc:341] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.770215 5721 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:39.742177 5756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99c4182493ae4faa8085c4f332f8c07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.771093 5620 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:39.772300 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:39.774008 5646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3855b3f3c6494a5491ce30bfc4b34d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.766749 5835 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.779433 5835 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:39.779907 5835 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:39.769680 5618 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:39.372460 5744 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7c63e776384e4191d85c1a670fcb60 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 13:32:39.754860 5839 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:39.782661 5839 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:39.783089 5744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7c63e776384e4191d85c1a670fcb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.711133 5746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 39) took 1028 ms. Trace:
I20260807 13:32:39.786332 5746 rpcz_store.cc:276] 0807 13:32:38.682636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.143986 (+461350us) service_pool.cc:227] Handling call
0807 13:32:39.145585 (+ 1599us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.145677 (+ 92us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.682446 (+536769us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.710616 (+ 28170us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.711069 (+ 453us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:39.788129 5746 tablet_service.cc:1467] Processing CreateTablet for tablet e23c0bda4b9045029b855a13c38aadb7 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 13:32:39.789319 5746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e23c0bda4b9045029b855a13c38aadb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.790731 5835 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:39.791551 5647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b950598d88564a8a85e1489e7f9843cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.809664 5869 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:39.810370 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:39.808714 5759 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 42) took 1068 ms. Trace:
W20260807 13:32:39.816417 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 73356.4us
I20260807 13:32:39.816166 5759 rpcz_store.cc:276] 0807 13:32:38.738186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.185493 (+447307us) service_pool.cc:227] Handling call
0807 13:32:39.224121 (+ 38628us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.224212 (+ 91us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.754718 (+530506us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.782014 (+ 27296us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.806273 (+ 24259us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5504}
I20260807 13:32:39.817294 5751 tablet_service.cc:1467] Processing CreateTablet for tablet 94e7bc4ef4d34614b8ba037cb437058c (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 13:32:39.817981 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:39.818971 5759 tablet_service.cc:1467] Processing CreateTablet for tablet abe57eac6430478584bb4e98bfff100f (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260807 13:32:39.819730 5620 leader_election.cc:341] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.813156 5651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abe57eac6430478584bb4e98bfff100f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.811960 5757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3855b3f3c6494a5491ce30bfc4b34d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.829600 5865 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:32:39.827378 5618 leader_election.cc:341] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.831074 5649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99f11806ff494d788e869d5368f88f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.838357 5653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e23c0bda4b9045029b855a13c38aadb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.838639 5837 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.841995 5747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 43) took 1089 ms. Trace:
I20260807 13:32:39.843117 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:39.842895 5747 rpcz_store.cc:276] 0807 13:32:38.752251 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.203403 (+451152us) service_pool.cc:227] Handling call
0807 13:32:39.245947 (+ 42544us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.254224 (+ 8277us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.770124 (+515900us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.825448 (+ 55324us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.841936 (+ 16488us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:32:39.844513 5499 leader_election.cc:341] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.844835 5747 tablet_service.cc:1467] Processing CreateTablet for tablet 99f11806ff494d788e869d5368f88f3b (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 13:32:39.845404 5654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99c4182493ae4faa8085c4f332f8c07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.846192 5828 tablet_bootstrap.cc:654] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:39.830070 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 60106us
W20260807 13:32:39.849435 5721 leader_election.cc:341] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.850498 5655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e7bc4ef4d34614b8ba037cb437058c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.858351 5760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83c1aab638794d7b89a5e2344158d7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.859059 5747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99f11806ff494d788e869d5368f88f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.866564 5744 tablet_service.cc:1467] Processing CreateTablet for tablet b950598d88564a8a85e1489e7f9843cb (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 13:32:39.867198 5618 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:39.867449 5759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abe57eac6430478584bb4e98bfff100f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:32:39.882712 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 62300us
I20260807 13:32:39.840834 5839 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.887975 5866 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:39.891059 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:39.892433 5555 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 1: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:32:39.869396 5837 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:39.869660 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:39.875922 5827 tablet_bootstrap.cc:492] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:39.901230 5827 ts_tablet_manager.cc:1397] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.565s user 0.020s sys 0.019s
I20260807 13:32:39.901361 5751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94e7bc4ef4d34614b8ba037cb437058c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.901487 5769 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:39.904066 5501 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:39.899928 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:39.911540 5839 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:39.916764 5646 tablet_service.cc:1467] Processing CreateTablet for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:32:39.918308 5646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 13:32:39.922343 5721 leader_election.cc:341] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:39.922789 5721 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:39.923821 5839 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:32:39.911413 5837 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:32:39.931705 5827 raft_consensus.cc:348] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.932469 5827 raft_consensus.cc:374] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:39.932756 5827 raft_consensus.cc:729] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:39.950531 5744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b950598d88564a8a85e1489e7f9843cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.950361 5757 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 51) took 1009 ms. Trace:
I20260807 13:32:39.951270 5757 rpcz_store.cc:276] 0807 13:32:38.940628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.716587 (+775959us) service_pool.cc:227] Handling call
0807 13:32:39.722325 (+ 5738us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.722856 (+ 531us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.936273 (+213417us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.949388 (+ 13115us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.950269 (+ 881us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:39.956526 5757 tablet_service.cc:1467] Processing CreateTablet for tablet 865420f31e38417a929d1a0f5c2009ac (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 13:32:39.958652 5757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 865420f31e38417a929d1a0f5c2009ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.960421 5648 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52568 (request call id 48) took 1048 ms. Trace:
I20260807 13:32:39.919360 5743 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 46) took 1036 ms. Trace:
I20260807 13:32:39.933437 5827 consensus_queue.cc:260] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:39.961061 5648 rpcz_store.cc:276] 0807 13:32:38.912214 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.269103 (+356889us) service_pool.cc:227] Handling call
0807 13:32:39.290056 (+ 20953us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.297167 (+ 7111us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.834945 (+537778us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.959444 (+124499us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.960316 (+ 872us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:39.963461 5743 rpcz_store.cc:276] 0807 13:32:38.882480 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.295258 (+412778us) service_pool.cc:227] Handling call
0807 13:32:39.364291 (+ 69033us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.364390 (+ 99us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.772679 (+408289us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.869746 (+ 97067us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.918859 (+ 49113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:39.980598 5645 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52568 (request call id 44) took 1204 ms. Trace:
I20260807 13:32:39.980965 5645 rpcz_store.cc:276] 0807 13:32:38.776123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.153824 (+377701us) service_pool.cc:227] Handling call
0807 13:32:39.158126 (+ 4302us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.158207 (+ 81us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.879271 (+721064us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.980072 (+100801us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.980542 (+ 470us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:39.981849 5743 tablet_service.cc:1467] Processing CreateTablet for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0 (DEFAULT_TABLE table=test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 13:32:39.983129 5743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:39.989202 5830 tablet_bootstrap.cc:654] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:39.995007 5756 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 49) took 1063 ms. Trace:
I20260807 13:32:39.995440 5756 rpcz_store.cc:276] 0807 13:32:38.931869 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.594228 (+662359us) service_pool.cc:227] Handling call
0807 13:32:39.717399 (+123171us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.717508 (+ 109us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.826031 (+108523us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:39.994329 (+168298us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:39.994940 (+ 611us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:40.019937 5828 tablet_bootstrap.cc:492] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:40.020645 5828 ts_tablet_manager.cc:1397] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.600s user 0.051s sys 0.045s
I20260807 13:32:40.024190 5751 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 53) took 1067 ms. Trace:
I20260807 13:32:40.024804 5751 rpcz_store.cc:276] 0807 13:32:38.956466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.816424 (+859958us) service_pool.cc:227] Handling call
0807 13:32:39.818134 (+ 1710us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.818232 (+ 98us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:40.008494 (+190262us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:40.023381 (+ 14887us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:40.024118 (+ 737us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:40.034159 5746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 52) took 1090 ms. Trace:
I20260807 13:32:40.034241 5758 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 44) took 1243 ms. Trace:
I20260807 13:32:40.034811 5746 rpcz_store.cc:276] 0807 13:32:38.943490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.787280 (+843790us) service_pool.cc:227] Handling call
0807 13:32:39.788895 (+ 1615us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.788994 (+ 99us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.946384 (+157390us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:40.033183 (+ 86799us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:40.034052 (+ 869us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:40.034922 5758 rpcz_store.cc:276] 0807 13:32:38.790749 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.220320 (+429571us) service_pool.cc:227] Handling call
0807 13:32:39.221985 (+ 1665us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.222088 (+ 103us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.956375 (+734287us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:40.033253 (+ 76878us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:40.034165 (+ 912us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":131}
I20260807 13:32:40.038600 5653 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52568 (request call id 52) took 1095 ms. Trace:
I20260807 13:32:40.039345 5653 rpcz_store.cc:276] 0807 13:32:38.942794 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.630347 (+687553us) service_pool.cc:227] Handling call
0807 13:32:39.719281 (+ 88934us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.719384 (+ 103us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.893323 (+173939us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:40.037539 (+144216us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:40.038497 (+ 958us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:40.040802 5654 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52568 (request call id 49) took 1120 ms. Trace:
I20260807 13:32:40.042368 5828 raft_consensus.cc:348] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.043216 5828 raft_consensus.cc:374] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.043591 5828 raft_consensus.cc:729] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.044076 5827 ts_tablet_manager.cc:1428] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.142s user 0.002s sys 0.012s
I20260807 13:32:40.044811 5828 consensus_queue.cc:260] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.046893 5827 tablet_bootstrap.cc:492] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:40.059082 5760 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 50) took 1126 ms. Trace:
I20260807 13:32:40.059711 5760 rpcz_store.cc:276] 0807 13:32:38.932239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.696377 (+764138us) service_pool.cc:227] Handling call
0807 13:32:39.764393 (+ 68016us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.764480 (+ 87us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:40.024343 (+259863us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:40.058355 (+ 34012us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:40.059006 (+ 651us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:40.061286 5827 tablet_bootstrap.cc:654] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.041442 5654 rpcz_store.cc:276] 0807 13:32:38.920906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.350663 (+429757us) service_pool.cc:227] Handling call
0807 13:32:39.360402 (+ 9739us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.360672 (+ 270us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.942566 (+581894us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:40.040183 (+ 97617us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:40.040744 (+ 561us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:40.065778 5830 tablet_bootstrap.cc:492] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:40.066390 5655 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52568 (request call id 53) took 1112 ms. Trace:
I20260807 13:32:40.066606 5830 ts_tablet_manager.cc:1397] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.804s user 0.079s sys 0.042s
I20260807 13:32:40.067004 5655 rpcz_store.cc:276] 0807 13:32:38.954147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.637802 (+683655us) service_pool.cc:227] Handling call
0807 13:32:39.719649 (+ 81847us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.719749 (+ 100us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:39.934451 (+214702us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:40.065509 (+131058us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:40.066295 (+ 786us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:40.072474 5828 ts_tablet_manager.cc:1428] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.051s user 0.004s sys 0.010s
I20260807 13:32:40.073609 5830 raft_consensus.cc:348] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.078281 5828 tablet_bootstrap.cc:492] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:40.075027 5830 raft_consensus.cc:374] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.080843 5830 raft_consensus.cc:729] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.085242 5827 tablet_bootstrap.cc:492] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:40.086068 5827 ts_tablet_manager.cc:1397] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.040s user 0.027s sys 0.001s
I20260807 13:32:40.086500 5830 consensus_queue.cc:260] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.091838 5827 raft_consensus.cc:348] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.092465 5747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 55) took 1061 ms. Trace:
I20260807 13:32:40.093122 5827 raft_consensus.cc:374] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.093690 5827 raft_consensus.cc:729] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.095153 5827 consensus_queue.cc:260] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.093302 5747 rpcz_store.cc:276] 0807 13:32:39.031012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.843909 (+812897us) service_pool.cc:227] Handling call
0807 13:32:39.845663 (+ 1754us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.845760 (+ 97us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:40.002647 (+156887us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:40.090228 (+ 87581us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:40.092392 (+ 2164us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:32:40.101595 5828 tablet_bootstrap.cc:654] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.106974 5827 ts_tablet_manager.cc:1428] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.020s user 0.008s sys 0.006s
I20260807 13:32:40.107182 5830 ts_tablet_manager.cc:1428] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.040s user 0.004s sys 0.010s
I20260807 13:32:40.108768 5744 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:32948 (request call id 56) took 1072 ms. Trace:
I20260807 13:32:40.109071 5827 tablet_bootstrap.cc:492] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:40.109936 5830 tablet_bootstrap.cc:492] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:40.109489 5744 rpcz_store.cc:276] 0807 13:32:39.036112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:32:39.865684 (+829572us) service_pool.cc:227] Handling call
0807 13:32:39.918451 (+ 52767us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0807 13:32:39.920663 (+ 2212us) ts_tablet_manager.cc:676] Creating new metadata...
0807 13:32:40.079166 (+158503us) tablet_metadata.cc:641] Metadata flushed
0807 13:32:40.107848 (+ 28682us) tablet_replica.cc:205] Creating consensus instance
0807 13:32:40.108669 (+ 821us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:32:40.118170 5597 tablet.cc:2369] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 13:32:40.123647 5828 tablet_bootstrap.cc:492] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:40.124338 5828 ts_tablet_manager.cc:1397] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.027s
I20260807 13:32:40.126720 5827 tablet_bootstrap.cc:654] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.127887 5830 tablet_bootstrap.cc:654] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.129938 5828 raft_consensus.cc:348] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.131145 5828 raft_consensus.cc:374] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.131605 5828 raft_consensus.cc:729] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.124341 5837 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.132848 5828 consensus_queue.cc:260] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.135526 5837 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.146497 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:40.147368 5666 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:40.152093 5837 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.153359 5499 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:40.155104 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.156827 5837 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:40.157166 5866 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.157464 5837 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:40.156479 5828 ts_tablet_manager.cc:1428] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.032s user 0.003s sys 0.013s
I20260807 13:32:40.157956 5866 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.159664 5828 tablet_bootstrap.cc:492] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:40.164152 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.165829 5769 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:40.158135 5837 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.168334 5866 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.174281 5828 tablet_bootstrap.cc:654] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:40.158126 5501 leader_election.cc:341] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.177069 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:40.178601 5555 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 1: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:32:40.180574 5618 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:40.182755 5866 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.196436 5830 tablet_bootstrap.cc:492] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:40.197158 5830 ts_tablet_manager.cc:1397] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.088s user 0.008s sys 0.033s
I20260807 13:32:40.197432 5866 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:40.200177 5837 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.203820 5837 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.203454 5830 raft_consensus.cc:348] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.204835 5830 raft_consensus.cc:374] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.204916 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:40.205253 5830 raft_consensus.cc:729] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.205495 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:40.205660 5666 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.206177 5830 consensus_queue.cc:260] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:40.207471 5501 leader_election.cc:341] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.209098 5828 tablet_bootstrap.cc:492] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:40.209939 5828 ts_tablet_manager.cc:1397] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.028s
I20260807 13:32:40.210609 5830 ts_tablet_manager.cc:1428] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.013s user 0.002s sys 0.010s
I20260807 13:32:40.211928 5827 tablet_bootstrap.cc:492] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:40.212688 5827 ts_tablet_manager.cc:1397] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.104s user 0.029s sys 0.044s
I20260807 13:32:40.216159 5828 raft_consensus.cc:348] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.216738 5666 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:40.217383 5828 raft_consensus.cc:374] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.217901 5828 raft_consensus.cc:729] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.218478 5499 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:40.218542 5827 raft_consensus.cc:348] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.219866 5827 raft_consensus.cc:374] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.220147 5837 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:40.220415 5827 raft_consensus.cc:729] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.220872 5837 raft_consensus.cc:686] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:40.221624 5827 consensus_queue.cc:260] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.221997 5837 consensus_queue.cc:237] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.224253 5830 tablet_bootstrap.cc:492] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:40.225982 5827 ts_tablet_manager.cc:1428] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.013s user 0.009s sys 0.002s
I20260807 13:32:40.227510 5827 tablet_bootstrap.cc:492] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:40.219256 5828 consensus_queue.cc:260] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.233186 5828 ts_tablet_manager.cc:1428] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.023s user 0.009s sys 0.001s
I20260807 13:32:40.236510 5828 tablet_bootstrap.cc:492] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:40.240108 5830 tablet_bootstrap.cc:654] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.241981 5827 tablet_bootstrap.cc:654] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.260764 5828 tablet_bootstrap.cc:654] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.266040 5389 catalog_manager.cc:5495] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:40.273188 5830 tablet_bootstrap.cc:492] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:40.272588 5827 tablet_bootstrap.cc:492] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:40.274366 5830 ts_tablet_manager.cc:1397] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.021s
I20260807 13:32:40.274855 5827 ts_tablet_manager.cc:1397] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.048s user 0.017s sys 0.026s
I20260807 13:32:40.278837 5828 tablet_bootstrap.cc:492] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:40.279651 5828 ts_tablet_manager.cc:1397] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.043s user 0.011s sys 0.019s
I20260807 13:32:40.280376 5830 raft_consensus.cc:348] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.281068 5827 raft_consensus.cc:348] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.281908 5830 raft_consensus.cc:374] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.282725 5827 raft_consensus.cc:374] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.282727 5830 raft_consensus.cc:729] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.283492 5827 raft_consensus.cc:729] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.284361 5830 consensus_queue.cc:260] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.285809 5828 raft_consensus.cc:348] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.287101 5828 raft_consensus.cc:374] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.287575 5828 raft_consensus.cc:729] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.289379 5830 ts_tablet_manager.cc:1428] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.015s user 0.003s sys 0.008s
I20260807 13:32:40.288945 5828 consensus_queue.cc:260] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.284937 5827 consensus_queue.cc:260] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.294291 5828 ts_tablet_manager.cc:1428] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.014s user 0.012s sys 0.002s
I20260807 13:32:40.294723 5827 ts_tablet_manager.cc:1428] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.019s user 0.008s sys 0.005s
I20260807 13:32:40.295106 5830 tablet_bootstrap.cc:492] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:40.295921 5827 tablet_bootstrap.cc:492] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:40.300894 5828 tablet_bootstrap.cc:492] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:40.312182 5827 tablet_bootstrap.cc:654] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.316864 5828 tablet_bootstrap.cc:654] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.322126 5830 tablet_bootstrap.cc:654] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.338284 5827 tablet_bootstrap.cc:492] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:40.339115 5827 ts_tablet_manager.cc:1397] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.043s user 0.012s sys 0.025s
I20260807 13:32:40.341207 5828 tablet_bootstrap.cc:492] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:40.342710 5828 ts_tablet_manager.cc:1397] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.042s user 0.018s sys 0.018s
I20260807 13:32:40.346149 5827 raft_consensus.cc:348] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.346634 5830 tablet_bootstrap.cc:492] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:40.347321 5827 raft_consensus.cc:374] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.347882 5830 ts_tablet_manager.cc:1397] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.057s user 0.008s sys 0.025s
I20260807 13:32:40.347826 5827 raft_consensus.cc:729] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.349115 5827 consensus_queue.cc:260] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.350557 5837 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.351328 5837 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.353941 5827 ts_tablet_manager.cc:1428] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.014s user 0.007s sys 0.006s
I20260807 13:32:40.353858 5830 raft_consensus.cc:348] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.355209 5830 raft_consensus.cc:374] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.355728 5830 raft_consensus.cc:729] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.355669 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:40.357764 5666 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:40.358247 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.357091 5830 consensus_queue.cc:260] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.360958 5499 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:40.363157 5830 ts_tablet_manager.cc:1428] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.015s user 0.008s sys 0.005s
W20260807 13:32:40.364264 5501 leader_election.cc:341] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.364861 5830 tablet_bootstrap.cc:492] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:40.363015 5869 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:40.368518 5869 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:40.368698 5837 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.369112 5869 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.371181 5827 tablet_bootstrap.cc:492] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:40.372911 5828 raft_consensus.cc:348] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.373729 5828 raft_consensus.cc:374] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.374053 5828 raft_consensus.cc:729] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.380962 5830 tablet_bootstrap.cc:654] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.385108 5869 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.381747 5828 consensus_queue.cc:260] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.389252 5828 ts_tablet_manager.cc:1428] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.046s user 0.008s sys 0.000s
I20260807 13:32:40.393260 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:40.395100 5501 leader_election.cc:341] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.395922 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:40.396598 5666 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.402652 5827 tablet_bootstrap.cc:654] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.408221 5666 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:40.409721 5499 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:40.409759 5828 tablet_bootstrap.cc:492] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:40.415934 5837 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:40.422266 5869 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.425984 5828 tablet_bootstrap.cc:654] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.428017 5837 raft_consensus.cc:686] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:40.429934 5837 consensus_queue.cc:237] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.438804 5828 tablet_bootstrap.cc:492] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:40.439057 5830 tablet_bootstrap.cc:492] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:40.439426 5828 ts_tablet_manager.cc:1397] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.030s user 0.013s sys 0.007s
I20260807 13:32:40.439875 5830 ts_tablet_manager.cc:1397] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.075s user 0.023s sys 0.025s
I20260807 13:32:40.440541 5839 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.440691 5827 tablet_bootstrap.cc:492] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:40.442159 5827 ts_tablet_manager.cc:1397] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.071s user 0.019s sys 0.032s
I20260807 13:32:40.441488 5839 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.446326 5830 raft_consensus.cc:348] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.446949 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:40.447538 5830 raft_consensus.cc:374] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.447315 5827 raft_consensus.cc:348] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.448150 5827 raft_consensus.cc:374] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.448029 5830 raft_consensus.cc:729] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.448868 5827 raft_consensus.cc:729] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
W20260807 13:32:40.449302 5722 leader_election.cc:341] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.449767 5827 consensus_queue.cc:260] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.449440 5830 consensus_queue.cc:260] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.453163 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:40.453735 5827 ts_tablet_manager.cc:1428] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.011s user 0.007s sys 0.003s
I20260807 13:32:40.454309 5666 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:40.455380 5827 tablet_bootstrap.cc:492] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:40.456561 5721 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:40.459493 5839 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:40.461751 5839 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:40.462414 5839 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:40.463136 5839 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.470476 5827 tablet_bootstrap.cc:654] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.476862 5828 raft_consensus.cc:348] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.477734 5828 raft_consensus.cc:374] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.478399 5828 raft_consensus.cc:729] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.478978 5828 consensus_queue.cc:260] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.477782 5830 ts_tablet_manager.cc:1428] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.037s user 0.006s sys 0.021s
I20260807 13:32:40.481181 5828 ts_tablet_manager.cc:1428] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.041s user 0.008s sys 0.001s
I20260807 13:32:40.481714 5837 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.482901 5828 tablet_bootstrap.cc:492] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:40.482563 5837 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.487426 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:40.488453 5666 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:40.485525 5390 catalog_manager.cc:5495] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:40.491833 5828 tablet_bootstrap.cc:654] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.492237 5499 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:40.493674 5903 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:40.494380 5903 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:40.495296 5830 tablet_bootstrap.cc:492] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:40.495015 5903 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.495003 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.498798 5769 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:40.503990 5837 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.511963 5839 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.517679 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:40.518263 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:40.519315 5666 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:40.519932 5722 leader_election.cc:341] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.522524 5830 tablet_bootstrap.cc:654] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.532434 5666 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:40.534453 5721 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:40.536973 5907 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:40.537971 5907 raft_consensus.cc:686] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:40.539685 5907 consensus_queue.cc:237] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.548920 5827 tablet_bootstrap.cc:492] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:40.549321 5827 ts_tablet_manager.cc:1397] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.095s user 0.013s sys 0.006s
I20260807 13:32:40.552305 5828 tablet_bootstrap.cc:492] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:40.552520 5827 raft_consensus.cc:348] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.553287 5827 raft_consensus.cc:374] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.553481 5828 ts_tablet_manager.cc:1397] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.071s user 0.012s sys 0.041s
I20260807 13:32:40.553380 5839 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:40.553572 5827 raft_consensus.cc:729] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.554737 5827 consensus_queue.cc:260] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.557153 5828 raft_consensus.cc:348] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.556723 5903 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.557927 5828 raft_consensus.cc:374] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.558266 5828 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.559058 5828 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.559856 5837 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.560598 5837 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.562084 5828 ts_tablet_manager.cc:1428] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 13:32:40.563201 5828 tablet_bootstrap.cc:492] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:40.567847 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.570822 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:32:40.571201 5501 leader_election.cc:341] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.571787 5667 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:40.572453 5828 tablet_bootstrap.cc:654] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.573220 5837 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.575860 5827 ts_tablet_manager.cc:1428] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.026s user 0.000s sys 0.008s
I20260807 13:32:40.576900 5827 tablet_bootstrap.cc:492] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:40.577503 5499 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:40.579214 5837 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:40.579847 5837 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:40.572458 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:40.580783 5869 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.584286 5839 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.584121 5869 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.584934 5839 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.588552 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:40.588773 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:40.590098 5721 leader_election.cc:341] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:40.590623 5722 leader_election.cc:341] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.582772 5837 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:40.592952 5802 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2ac0 after lost signal to thread 3828
W20260807 13:32:40.594329 5802 debug-util.cc:398] Leaking SignalData structure 0x7b080009f740 after lost signal to thread 5446
I20260807 13:32:40.595875 5839 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:40.603411 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:40.604619 5769 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.591339 5722 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:40.607697 5866 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:32:40.608877 5802 debug-util.cc:398] Leaking SignalData structure 0x7b08000b15a0 after lost signal to thread 5594
I20260807 13:32:40.608445 5866 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:40.610894 5802 debug-util.cc:398] Leaking SignalData structure 0x7b080014d000 after lost signal to thread 5702
W20260807 13:32:40.612560 5802 debug-util.cc:398] Leaking SignalData structure 0x7b08000a34c0 after lost signal to thread 5805
I20260807 13:32:40.617247 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:40.618854 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:40.619879 5555 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:40.614013 5839 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:40.614611 5903 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.618736 5667 raft_consensus.cc:2379] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:40.619935 5666 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.625241 5618 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:40.628423 5389 catalog_manager.cc:5495] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:40.622061 5869 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.625521 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.631727 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.642321 5827 tablet_bootstrap.cc:654] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.633093 5866 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.643685 5866 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:40.644249 5866 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:32:40.644243 5620 leader_election.cc:341] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.646250 5499 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:40.648012 5866 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.651474 5830 tablet_bootstrap.cc:492] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:40.652168 5830 ts_tablet_manager.cc:1397] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.157s user 0.038s sys 0.044s
I20260807 13:32:40.653182 5903 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.655937 5830 raft_consensus.cc:348] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.656978 5830 raft_consensus.cc:374] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.657877 5839 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.658466 5839 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.660863 5839 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:40.657351 5830 raft_consensus.cc:729] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.662678 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:40.663298 5555 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:40.663337 5830 consensus_queue.cc:260] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.664546 5722 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:40.664346 5769 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:40.665378 5839 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:40.671355 5903 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:40.673573 5839 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:40.672165 5866 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.674292 5839 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.671921 5869 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:40.680953 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:40.683593 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 60473.4us
I20260807 13:32:40.684080 5770 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.684942 5828 tablet_bootstrap.cc:492] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:40.685410 5828 ts_tablet_manager.cc:1397] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.122s user 0.007s sys 0.034s
I20260807 13:32:40.686841 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:40.686753 5501 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:40.687808 5555 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.688359 5903 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:40.691005 5830 ts_tablet_manager.cc:1428] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.038s user 0.006s sys 0.001s
I20260807 13:32:40.692013 5830 tablet_bootstrap.cc:492] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:40.693179 5828 raft_consensus.cc:348] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.694048 5828 raft_consensus.cc:374] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.694398 5828 raft_consensus.cc:729] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.695140 5828 consensus_queue.cc:260] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.697934 5828 ts_tablet_manager.cc:1428] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260807 13:32:40.698918 5828 tablet_bootstrap.cc:492] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:40.678591 5866 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.701151 5907 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.704105 5907 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.709498 5837 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.710191 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:40.711191 5667 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:40.713202 5907 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:40.714423 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:40.715101 5667 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.716511 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:40.720534 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:40.729245 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:40.731689 5501 leader_election.cc:341] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.732784 5828 tablet_bootstrap.cc:654] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.734560 5837 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.738907 5721 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:40.740286 5907 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:32:40.744472 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:40.743911 5555 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:40.750066 5618 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:40.747684 5903 raft_consensus.cc:686] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:40.751981 5827 tablet_bootstrap.cc:492] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:40.752182 5919 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:40.752635 5827 ts_tablet_manager.cc:1397] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.176s user 0.013s sys 0.006s
I20260807 13:32:40.753048 5919 raft_consensus.cc:686] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:40.742002 5839 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.760722 5666 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:40.763067 5827 raft_consensus.cc:348] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.767748 5827 raft_consensus.cc:374] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.763271 5919 consensus_queue.cc:237] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.768479 5839 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:40.770172 5827 raft_consensus.cc:729] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.769809 5903 consensus_queue.cc:237] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.769239 5770 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:40.771736 5827 consensus_queue.cc:260] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.769636 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:40.773490 5555 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.779214 5827 ts_tablet_manager.cc:1428] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.026s user 0.008s sys 0.002s
I20260807 13:32:40.795414 5827 tablet_bootstrap.cc:492] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:40.776499 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:40.806948 5666 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.809010 5828 tablet_bootstrap.cc:492] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:40.809557 5828 ts_tablet_manager.cc:1397] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.111s user 0.014s sys 0.007s
I20260807 13:32:40.814435 5828 raft_consensus.cc:348] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.815316 5828 raft_consensus.cc:374] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.815646 5828 raft_consensus.cc:729] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.818307 5828 consensus_queue.cc:260] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.821429 5837 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.825661 5828 ts_tablet_manager.cc:1428] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.016s user 0.008s sys 0.004s
I20260807 13:32:40.827011 5828 tablet_bootstrap.cc:492] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:40.822213 5837 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.845357 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.845145 5390 catalog_manager.cc:5495] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
W20260807 13:32:40.848634 5501 leader_election.cc:341] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.827152 5667 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:40.845070 5555 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:40.853446 5722 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:40.858532 5919 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.857190 5499 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:40.859081 5919 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.861146 5869 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:40.861542 5919 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.861987 5869 raft_consensus.cc:686] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:40.862349 5839 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:40.863191 5839 raft_consensus.cc:686] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:40.864459 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.863929 5869 consensus_queue.cc:237] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.865622 5770 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:40.867430 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:40.867712 5620 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:40.864872 5839 consensus_queue.cc:237] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.851481 5837 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.869714 5919 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:40.870360 5919 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:40.871011 5919 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:40.874522 5499 leader_election.cc:341] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.875598 5499 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:40.879931 5903 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:40.883950 5830 tablet_bootstrap.cc:654] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.885998 5389 catalog_manager.cc:5495] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:40.894600 5666 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:40.898734 5866 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.899498 5866 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.900463 5827 tablet_bootstrap.cc:654] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:40.902263 5919 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.909474 5919 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.910354 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:40.915338 5770 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.921064 5866 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.923429 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:40.925711 5620 leader_election.cc:341] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.934655 5771 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.939368 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:40.941926 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:40.943810 5555 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:40.944888 5390 catalog_manager.cc:5495] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
W20260807 13:32:40.952755 5501 consensus_peers.cc:487] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:32:40.954566 5618 leader_election.cc:341] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.956637 5618 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:40.958169 5866 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:40.958839 5866 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:40.959478 5866 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.962847 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:40.968914 5919 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:40.969714 5919 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.979472 5932 consensus_queue.cc:1035] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260807 13:32:40.982738 5827 tablet_bootstrap.cc:492] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:40.983172 5827 ts_tablet_manager.cc:1397] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.188s user 0.018s sys 0.010s
I20260807 13:32:40.985011 5866 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.987840 5827 raft_consensus.cc:348] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.988621 5827 raft_consensus.cc:374] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:40.988973 5827 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:40.991389 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:40.990569 5389 catalog_manager.cc:5495] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:40.989753 5827 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:40.988806 5919 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:40.993355 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:40.997129 5869 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260807 13:32:40.995272 5618 leader_election.cc:341] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.996628 5919 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.003232 5919 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.003850 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:41.004081 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:41.004575 5555 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:40.989720 5866 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.005509 5828 tablet_bootstrap.cc:654] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.007694 5827 ts_tablet_manager.cc:1428] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.024s user 0.008s sys 0.000s
I20260807 13:32:41.008868 5827 tablet_bootstrap.cc:492] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
W20260807 13:32:41.009153 5618 leader_election.cc:341] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:40.997030 5770 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:41.015633 5830 tablet_bootstrap.cc:492] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:41.015862 5919 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.016075 5830 ts_tablet_manager.cc:1397] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.324s user 0.009s sys 0.014s
I20260807 13:32:41.019886 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:41.020633 5620 leader_election.cc:341] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:41.021266 5620 leader_election.cc:341] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.021863 5830 raft_consensus.cc:348] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.022750 5830 raft_consensus.cc:374] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.023092 5830 raft_consensus.cc:729] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.023412 5839 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.024006 5830 consensus_queue.cc:260] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:41.023839 5618 leader_election.cc:341] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.025382 5827 tablet_bootstrap.cc:654] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.026512 5830 ts_tablet_manager.cc:1428] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20260807 13:32:41.027513 5830 tablet_bootstrap.cc:492] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:41.021776 5620 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:41.031807 5919 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:41.041623 5620 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:41.045563 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:41.048799 5839 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.039431 5555 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:41.052673 5938 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 13:32:41.054386 5620 leader_election.cc:341] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.055120 5620 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:41.057376 5938 raft_consensus.cc:686] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:41.061599 5919 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:41.059697 5938 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.070145 5828 tablet_bootstrap.cc:492] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:41.062165 5618 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:41.070691 5828 ts_tablet_manager.cc:1397] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.244s user 0.018s sys 0.017s
I20260807 13:32:41.071101 5866 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:41.072256 5866 raft_consensus.cc:686] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:41.076571 5866 consensus_queue.cc:237] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.085263 5830 tablet_bootstrap.cc:654] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.088425 5828 raft_consensus.cc:348] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.089648 5828 raft_consensus.cc:374] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.090030 5828 raft_consensus.cc:729] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.090924 5828 consensus_queue.cc:260] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.099627 5828 ts_tablet_manager.cc:1428] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.029s user 0.008s sys 0.002s
I20260807 13:32:41.100607 5828 tablet_bootstrap.cc:492] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:41.118252 5830 tablet_bootstrap.cc:492] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:41.118851 5830 ts_tablet_manager.cc:1397] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.092s user 0.020s sys 0.012s
I20260807 13:32:41.123714 5830 raft_consensus.cc:348] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.124363 5830 raft_consensus.cc:374] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.124611 5830 raft_consensus.cc:729] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.125478 5830 consensus_queue.cc:260] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.128774 5830 ts_tablet_manager.cc:1428] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.010s user 0.005s sys 0.003s
I20260807 13:32:41.130131 5830 tablet_bootstrap.cc:492] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:41.139160 5394 catalog_manager.cc:5495] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:41.144268 5839 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.167732 5827 tablet_bootstrap.cc:492] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:41.168269 5827 ts_tablet_manager.cc:1397] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.160s user 0.013s sys 0.021s
I20260807 13:32:41.151248 5839 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.173444 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:41.175112 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:41.176160 5666 raft_consensus.cc:2379] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 1: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:32:41.177824 5721 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:41.187467 5827 raft_consensus.cc:348] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.189764 5827 raft_consensus.cc:374] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.190222 5827 raft_consensus.cc:729] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.179343 5839 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:41.199779 5827 consensus_queue.cc:260] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.201617 5839 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.204097 5866 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.204810 5866 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.206522 5930 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260807 13:32:41.208768 5828 tablet_bootstrap.cc:654] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.212874 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:41.213361 5958 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.213876 5556 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:41.214201 5958 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.215544 5618 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:41.219817 5958 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:41.223945 5827 ts_tablet_manager.cc:1428] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.055s user 0.008s sys 0.001s
I20260807 13:32:41.225238 5827 tablet_bootstrap.cc:492] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:41.228129 5919 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:41.228386 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:41.228785 5919 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:41.229158 5556 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:41.229259 5919 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.216636 5839 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:41.232861 5722 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:41.233870 5866 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.234016 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:41.235252 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:41.235710 5830 tablet_bootstrap.cc:654] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.235863 5767 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:41.240835 5828 tablet_bootstrap.cc:492] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:41.241394 5828 ts_tablet_manager.cc:1397] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.141s user 0.016s sys 0.012s
I20260807 13:32:41.246287 5960 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:41.249859 5960 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:41.251194 5960 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.244266 5390 catalog_manager.cc:5495] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:41.251636 5919 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.259796 5666 raft_consensus.cc:2379] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 1: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:32:41.261569 5827 tablet_bootstrap.cc:654] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.265345 5869 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.266208 5828 raft_consensus.cc:348] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.268992 5828 raft_consensus.cc:374] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.269460 5828 raft_consensus.cc:729] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.270726 5828 consensus_queue.cc:260] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.272935 5919 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.280613 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:41.280792 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:41.281519 5556 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.284099 5828 ts_tablet_manager.cc:1428] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.042s user 0.004s sys 0.004s
I20260807 13:32:41.285218 5828 tablet_bootstrap.cc:492] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:41.311823 5556 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:41.311748 5960 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.318496 5618 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:41.320745 5919 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:41.321384 5919 raft_consensus.cc:686] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:41.322737 5919 consensus_queue.cc:237] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.325747 5960 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:41.326541 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:41.327476 5770 raft_consensus.cc:2379] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:41.327338 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:41.339497 5869 consensus_queue.cc:1035] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.342093 5830 tablet_bootstrap.cc:492] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:41.342645 5830 ts_tablet_manager.cc:1397] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.213s user 0.011s sys 0.013s
I20260807 13:32:41.347163 5830 raft_consensus.cc:348] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.347993 5830 raft_consensus.cc:374] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.348352 5830 raft_consensus.cc:729] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.351049 5556 raft_consensus.cc:2379] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 1: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:32:41.352504 5866 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.352962 5722 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:41.354846 5839 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 13:32:41.349179 5830 consensus_queue.cc:260] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.364621 5828 tablet_bootstrap.cc:654] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.366446 5830 ts_tablet_manager.cc:1428] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.023s user 0.007s sys 0.001s
I20260807 13:32:41.367406 5830 tablet_bootstrap.cc:492] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:41.391270 5827 tablet_bootstrap.cc:492] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:41.391844 5827 ts_tablet_manager.cc:1397] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.167s user 0.014s sys 0.017s
I20260807 13:32:41.391578 5869 consensus_queue.cc:1035] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.387902 5919 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260807 13:32:41.402806 5830 tablet_bootstrap.cc:654] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.406570 5869 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.407410 5869 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.413118 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:41.430121 5827 raft_consensus.cc:348] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.435319 5827 raft_consensus.cc:374] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.435680 5827 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.436504 5827 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:41.434525 5499 leader_election.cc:341] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.415859 5869 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.417850 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:41.446251 5501 leader_election.cc:341] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.447026 5501 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:41.449371 5869 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:41.429108 5390 catalog_manager.cc:5495] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:41.455202 5827 ts_tablet_manager.cc:1428] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.063s user 0.007s sys 0.008s
I20260807 13:32:41.456497 5827 tablet_bootstrap.cc:492] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:41.482030 5828 tablet_bootstrap.cc:492] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:41.482694 5828 ts_tablet_manager.cc:1397] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.198s user 0.023s sys 0.031s
I20260807 13:32:41.483901 5960 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.488922 5960 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:41.489727 5828 raft_consensus.cc:348] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.490504 5828 raft_consensus.cc:374] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.490813 5828 raft_consensus.cc:729] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.492576 5827 tablet_bootstrap.cc:654] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.492496 5828 consensus_queue.cc:260] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.495100 5828 ts_tablet_manager.cc:1428] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20260807 13:32:41.496189 5828 tablet_bootstrap.cc:492] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:41.538220 5866 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.540277 5866 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.546408 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:41.548652 5618 leader_election.cc:341] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.550093 5866 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.554374 5828 tablet_bootstrap.cc:654] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.555030 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:41.559959 5620 consensus_peers.cc:487] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:32:41.564456 5620 leader_election.cc:341] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.565222 5620 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:41.567602 5938 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:41.568475 5938 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.569963 5920 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.570767 5920 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.576534 5837 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.577208 5837 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.580542 5837 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.585629 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:41.589758 5830 tablet_bootstrap.cc:492] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:41.590538 5830 ts_tablet_manager.cc:1397] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.223s user 0.027s sys 0.035s
I20260807 13:32:41.590956 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:41.590454 5920 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:32:41.594076 5499 leader_election.cc:341] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.600476 5827 tablet_bootstrap.cc:492] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:41.600991 5827 ts_tablet_manager.cc:1397] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.145s user 0.014s sys 0.005s
I20260807 13:32:41.605356 5827 raft_consensus.cc:348] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.607066 5830 raft_consensus.cc:348] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.608176 5827 raft_consensus.cc:374] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.608227 5830 raft_consensus.cc:374] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.608551 5827 raft_consensus.cc:729] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.611474 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:41.613067 5827 consensus_queue.cc:260] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.608582 5830 raft_consensus.cc:729] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.619573 5827 ts_tablet_manager.cc:1428] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.018s user 0.003s sys 0.007s
I20260807 13:32:41.621253 5827 tablet_bootstrap.cc:492] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:41.625406 5769 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:41.626546 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:41.628597 5501 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:41.620142 5830 consensus_queue.cc:260] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.631199 5501 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:41.632524 5837 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:41.633003 5837 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:41.633374 5837 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.634840 5830 ts_tablet_manager.cc:1428] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.044s user 0.008s sys 0.000s
I20260807 13:32:41.630121 5920 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:41.636576 5830 tablet_bootstrap.cc:492] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:41.651335 5837 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.661402 5837 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.654845 5828 tablet_bootstrap.cc:492] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:41.662283 5828 ts_tablet_manager.cc:1397] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.166s user 0.019s sys 0.028s
I20260807 13:32:41.672791 5919 consensus_queue.cc:1035] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:32:41.665884 5556 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.652141 5827 tablet_bootstrap.cc:654] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.672848 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:41.678591 5771 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.657835 5830 tablet_bootstrap.cc:654] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.666203 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:41.670672 5828 raft_consensus.cc:348] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.687026 5828 raft_consensus.cc:374] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.687404 5828 raft_consensus.cc:729] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.688154 5828 consensus_queue.cc:260] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.690879 5828 ts_tablet_manager.cc:1428] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.028s user 0.009s sys 0.000s
I20260807 13:32:41.691932 5828 tablet_bootstrap.cc:492] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:41.694681 5665 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.694739 5919 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.713641 5919 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.714411 5919 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.720747 5866 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.721675 5866 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.729614 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:41.730607 5554 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:41.732261 5618 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:41.733495 5938 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:32:41.733975 5938 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:41.734580 5938 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:41.735206 5828 tablet_bootstrap.cc:654] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.739341 5919 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.747146 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:41.749256 5827 tablet_bootstrap.cc:492] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
W20260807 13:32:41.749302 5620 leader_election.cc:341] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.749799 5827 ts_tablet_manager.cc:1397] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.129s user 0.003s sys 0.030s
I20260807 13:32:41.751950 5866 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:32:41.758705 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:41.765707 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:41.766764 5770 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:41.785416 5771 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:41.788367 5828 tablet_bootstrap.cc:492] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:41.789003 5828 ts_tablet_manager.cc:1397] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.097s user 0.019s sys 0.009s
I20260807 13:32:41.797874 5919 consensus_queue.cc:1035] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:32:41.803669 5828 raft_consensus.cc:348] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.804175 5958 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.804629 5828 raft_consensus.cc:374] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.805167 5828 raft_consensus.cc:729] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.804991 5958 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.806366 5828 consensus_queue.cc:260] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.807478 5827 raft_consensus.cc:348] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.808300 5827 raft_consensus.cc:374] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.808595 5827 raft_consensus.cc:729] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.809237 5828 ts_tablet_manager.cc:1428] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260807 13:32:41.810328 5828 tablet_bootstrap.cc:492] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:41.809371 5827 consensus_queue.cc:260] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.788846 5501 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:41.810672 5958 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:32:41.787022 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 47970.4us
I20260807 13:32:41.814400 5830 tablet_bootstrap.cc:492] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:41.814939 5830 ts_tablet_manager.cc:1397] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.179s user 0.007s sys 0.020s
I20260807 13:32:41.815119 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:41.817855 5920 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:41.818483 5920 raft_consensus.cc:686] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:41.818248 5938 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.820919 5920 consensus_queue.cc:237] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.825430 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:41.826713 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:41.827566 5769 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:41.828037 5828 tablet_bootstrap.cc:654] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.815099 5665 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:41.832167 5827 ts_tablet_manager.cc:1428] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.082s user 0.009s sys 0.000s
I20260807 13:32:41.832841 5827 tablet_bootstrap.cc:492] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:41.831184 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:41.838521 5618 leader_election.cc:341] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.839299 5618 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:41.830228 5938 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:41.840639 6002 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:41.843307 5958 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:41.845074 5958 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.846909 5830 raft_consensus.cc:348] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.847769 5830 raft_consensus.cc:374] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.848057 5830 raft_consensus.cc:729] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.848728 5830 consensus_queue.cc:260] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.850345 5958 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:41.852972 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:41.853168 5722 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:41.853852 5555 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:41.855171 5958 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:41.856176 5830 ts_tablet_manager.cc:1428] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.041s user 0.005s sys 0.005s
I20260807 13:32:41.858251 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:41.859740 5769 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
W20260807 13:32:41.860831 5722 leader_election.cc:341] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.861739 5620 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:41.863116 5830 tablet_bootstrap.cc:492] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:41.864264 5919 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:41.864997 5919 raft_consensus.cc:686] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:41.866250 5919 consensus_queue.cc:237] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.883445 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:41.884907 5665 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:41.889140 5721 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:41.891019 5555 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:32:41.891456 5958 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:41.892259 5958 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:41.892925 5958 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.898864 5830 tablet_bootstrap.cc:654] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.901671 5390 catalog_manager.cc:5495] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:41.907305 5827 tablet_bootstrap.cc:654] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:41.912868 5828 tablet_bootstrap.cc:492] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:41.913311 5828 ts_tablet_manager.cc:1397] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.103s user 0.020s sys 0.020s
I20260807 13:32:41.933259 5958 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.943590 5919 consensus_queue.cc:1035] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:41.946152 5958 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:41.949667 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:41.952103 5665 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.952425 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:32:41.958500 5722 leader_election.cc:341] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:41.966010 5769 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:41.975261 5828 raft_consensus.cc:348] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.975953 5828 raft_consensus.cc:374] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:41.976207 5828 raft_consensus.cc:729] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:41.976764 5828 consensus_queue.cc:260] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.979974 5665 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:41.981626 5721 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:41.982906 5958 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:41.983237 5830 tablet_bootstrap.cc:492] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:41.983465 5958 raft_consensus.cc:686] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:41.983767 5830 ts_tablet_manager.cc:1397] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.121s user 0.007s sys 0.019s
I20260807 13:32:41.985040 5958 consensus_queue.cc:237] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:41.993834 5391 catalog_manager.cc:5495] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 2, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:42.000572 5828 ts_tablet_manager.cc:1428] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.087s user 0.005s sys 0.005s
I20260807 13:32:42.001919 5828 tablet_bootstrap.cc:492] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:42.002452 5827 tablet_bootstrap.cc:492] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:42.002957 5827 ts_tablet_manager.cc:1397] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.170s user 0.010s sys 0.009s
I20260807 13:32:42.018488 5390 catalog_manager.cc:5495] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:42.021121 5827 raft_consensus.cc:348] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.021938 5827 raft_consensus.cc:374] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.022368 5827 raft_consensus.cc:729] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.023092 5827 consensus_queue.cc:260] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.024835 5830 raft_consensus.cc:348] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.027536 5827 ts_tablet_manager.cc:1428] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.024s user 0.007s sys 0.005s
I20260807 13:32:42.031383 5827 tablet_bootstrap.cc:492] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:42.035488 5830 raft_consensus.cc:374] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.035866 5830 raft_consensus.cc:729] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.036707 5830 consensus_queue.cc:260] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.030289 5828 tablet_bootstrap.cc:654] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.046677 5830 ts_tablet_manager.cc:1428] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.045s user 0.004s sys 0.004s
I20260807 13:32:42.047719 5830 tablet_bootstrap.cc:492] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:42.049296 5771 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.051384 5827 tablet_bootstrap.cc:654] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.069676 6002 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.070159 6002 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.072333 6002 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.073107 5869 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.073866 5869 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.074402 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:42.075992 5620 leader_election.cc:341] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.077145 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:42.077929 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:42.078444 5499 leader_election.cc:341] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.078636 5770 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:42.079747 5920 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.079890 5501 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:42.080210 5920 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.081100 5837 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:42.081436 5837 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:42.081889 5837 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.082207 5920 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.084928 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:42.085239 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:42.086198 5665 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:42.087946 5499 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:42.084453 5869 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.089359 5920 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:42.089929 5920 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:42.090466 5920 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:42.093376 5618 leader_election.cc:341] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.093514 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:42.094183 5618 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:42.096024 6002 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:32:42.095369 5501 leader_election.cc:341] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.104115 5827 tablet_bootstrap.cc:492] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:42.104542 5827 ts_tablet_manager.cc:1397] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.073s user 0.021s sys 0.025s
I20260807 13:32:42.107653 5837 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.110241 5830 tablet_bootstrap.cc:654] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.110801 5828 tablet_bootstrap.cc:492] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:42.111212 5828 ts_tablet_manager.cc:1397] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.110s user 0.015s sys 0.011s
I20260807 13:32:42.113382 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:32:42.115522 5499 leader_election.cc:341] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.115147 5827 raft_consensus.cc:348] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.118175 5827 raft_consensus.cc:374] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.118552 5827 raft_consensus.cc:729] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.119630 5827 consensus_queue.cc:260] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.120659 5837 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.122025 5827 ts_tablet_manager.cc:1428] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20260807 13:32:42.123308 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:42.123960 5770 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.125051 5828 raft_consensus.cc:348] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.125789 5828 raft_consensus.cc:374] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.126132 5828 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.128100 5828 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.130080 5828 ts_tablet_manager.cc:1428] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.019s user 0.002s sys 0.004s
I20260807 13:32:42.135663 5920 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.138793 5828 tablet_bootstrap.cc:492] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:42.146931 5827 tablet_bootstrap.cc:492] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:42.144133 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:42.153070 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:42.149634 5920 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.154206 5665 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:42.162907 5501 leader_election.cc:341] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.175720 5827 tablet_bootstrap.cc:654] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.177361 5830 tablet_bootstrap.cc:492] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:42.177834 5830 ts_tablet_manager.cc:1397] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.130s user 0.017s sys 0.015s
I20260807 13:32:42.181996 5830 raft_consensus.cc:348] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.182889 5830 raft_consensus.cc:374] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.183243 5830 raft_consensus.cc:729] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.184168 5830 consensus_queue.cc:260] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.185074 5770 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:42.187274 5830 ts_tablet_manager.cc:1428] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 13:32:42.187065 5501 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:42.188320 5830 tablet_bootstrap.cc:492] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:42.189316 5920 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:42.190160 5920 raft_consensus.cc:686] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:42.190315 6002 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.191053 6002 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.191874 5920 consensus_queue.cc:237] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.196826 6002 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.196936 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:42.198038 5555 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:42.200094 5618 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:42.201550 5837 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.202267 5837 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.201826 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:42.204597 6002 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:42.209156 6002 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:42.209738 6002 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.211546 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:42.212550 5666 raft_consensus.cc:2379] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:42.214530 5837 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:32:42.215389 5620 leader_election.cc:341] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.213106 5665 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:42.220515 5828 tablet_bootstrap.cc:654] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.221696 5499 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:42.222121 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:42.226491 5837 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:42.227463 5837 raft_consensus.cc:686] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:42.228946 5837 consensus_queue.cc:237] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.232728 5501 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:42.235038 5920 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.241400 5390 catalog_manager.cc:5495] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:42.245929 5920 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:42.250718 5827 tablet_bootstrap.cc:492] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:42.251121 5827 ts_tablet_manager.cc:1397] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.104s user 0.009s sys 0.022s
I20260807 13:32:42.252544 6002 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.258201 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:42.259104 5555 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.262959 5828 tablet_bootstrap.cc:492] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:42.263101 6002 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.263366 5828 ts_tablet_manager.cc:1397] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.125s user 0.004s sys 0.016s
I20260807 13:32:42.267459 5830 tablet_bootstrap.cc:654] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.266891 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:42.278435 5827 raft_consensus.cc:348] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.286191 5827 raft_consensus.cc:374] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.286494 5827 raft_consensus.cc:729] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.274572 5390 catalog_manager.cc:5495] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:42.283878 5769 raft_consensus.cc:1261] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260807 13:32:42.286621 5620 leader_election.cc:341] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.287209 5827 consensus_queue.cc:260] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.288470 6002 consensus_queue.cc:1035] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:42.290127 5827 ts_tablet_manager.cc:1428] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.039s user 0.012s sys 0.002s
I20260807 13:32:42.291236 5827 tablet_bootstrap.cc:492] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:42.279453 5828 raft_consensus.cc:348] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.305799 5828 raft_consensus.cc:374] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.306061 5828 raft_consensus.cc:729] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.306743 5828 consensus_queue.cc:260] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.311900 5828 ts_tablet_manager.cc:1428] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.045s user 0.007s sys 0.000s
I20260807 13:32:42.312767 5828 tablet_bootstrap.cc:492] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:42.317474 5920 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.318179 5920 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.322307 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:42.323275 5666 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:42.326869 5499 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:42.327224 5837 consensus_queue.cc:1035] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:42.327550 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:42.328284 5869 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:42.328840 5869 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:42.329465 5869 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.329840 5920 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.331295 5555 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:42.328650 5556 raft_consensus.cc:1261] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260807 13:32:42.329381 5501 leader_election.cc:341] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.343397 5618 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:42.345784 5919 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:42.346604 5919 raft_consensus.cc:686] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:42.346619 6002 consensus_queue.cc:1035] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:32:42.348227 5919 consensus_queue.cc:237] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.379555 5828 tablet_bootstrap.cc:654] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.388921 5827 tablet_bootstrap.cc:654] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.407052 5830 tablet_bootstrap.cc:492] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:42.407534 5830 ts_tablet_manager.cc:1397] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.219s user 0.029s sys 0.055s
I20260807 13:32:42.391149 5869 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.418049 5830 raft_consensus.cc:348] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.419806 5830 raft_consensus.cc:374] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.420157 5830 raft_consensus.cc:729] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.420915 5830 consensus_queue.cc:260] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.423691 5938 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.424368 5938 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.430759 5830 ts_tablet_manager.cc:1428] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.023s user 0.009s sys 0.001s
I20260807 13:32:42.432953 5830 tablet_bootstrap.cc:492] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:42.439364 5920 consensus_queue.cc:1035] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:42.448225 6002 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.449498 6002 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.452342 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:42.453099 5938 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.453385 5667 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.455164 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:42.456123 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:42.457307 5618 leader_election.cc:341] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.443852 5869 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:32:42.479490 5501 leader_election.cc:341] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.484503 6002 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.484714 5958 consensus_queue.cc:1035] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:42.487782 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:42.484439 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:42.488656 5555 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:42.494796 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:42.495786 5769 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:42.496904 5667 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:42.497495 5618 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:32:42.493657 5620 leader_election.cc:341] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.498605 6002 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:42.499104 6002 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:42.498888 5620 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:42.501077 5499 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:42.503417 5919 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:42.501885 6002 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.502068 5394 catalog_manager.cc:5495] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:42.505537 5827 tablet_bootstrap.cc:492] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:42.503988 6043 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:42.505952 5827 ts_tablet_manager.cc:1397] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.215s user 0.017s sys 0.011s
I20260807 13:32:42.506336 6043 raft_consensus.cc:686] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:42.513931 5828 tablet_bootstrap.cc:492] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:42.514387 5828 ts_tablet_manager.cc:1397] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.202s user 0.021s sys 0.011s
I20260807 13:32:42.516681 5828 raft_consensus.cc:348] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.517316 5828 raft_consensus.cc:374] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.526479 5828 raft_consensus.cc:729] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.522065 6043 consensus_queue.cc:237] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.526824 5830 tablet_bootstrap.cc:654] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.526536 5827 raft_consensus.cc:348] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.531626 5827 raft_consensus.cc:374] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.531903 5827 raft_consensus.cc:729] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.532472 5827 consensus_queue.cc:260] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.519905 6002 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.537398 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:42.527366 5828 consensus_queue.cc:260] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.537945 5554 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.541762 5827 ts_tablet_manager.cc:1428] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.035s user 0.007s sys 0.001s
I20260807 13:32:42.544483 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:42.545457 5769 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.552999 6002 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.558741 5827 tablet_bootstrap.cc:492] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:42.565950 5828 ts_tablet_manager.cc:1428] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.051s user 0.005s sys 0.002s
I20260807 13:32:42.575379 5958 consensus_queue.cc:1035] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:42.565886 5769 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:42.577296 5828 tablet_bootstrap.cc:492] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:42.579830 5620 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:42.582481 6002 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:42.585578 6002 raft_consensus.cc:686] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:42.590652 5830 tablet_bootstrap.cc:492] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:42.591166 5830 ts_tablet_manager.cc:1397] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.160s user 0.008s sys 0.011s
I20260807 13:32:42.595526 6002 consensus_queue.cc:237] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.640940 5919 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.641651 5919 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.649786 5666 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.656306 5828 tablet_bootstrap.cc:654] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.658315 5554 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:42.659999 5830 raft_consensus.cc:348] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.661820 5919 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.664213 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:42.663506 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:42.661976 5827 tablet_bootstrap.cc:654] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.672271 5830 raft_consensus.cc:374] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.677079 5830 raft_consensus.cc:729] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.679569 5769 raft_consensus.cc:2379] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 1: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:32:42.677927 5830 consensus_queue.cc:260] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.680850 5620 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:42.683261 5919 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:42.684968 5830 ts_tablet_manager.cc:1428] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.093s user 0.020s sys 0.017s
I20260807 13:32:42.685858 5830 tablet_bootstrap.cc:492] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:42.690845 5394 catalog_manager.cc:5495] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:42.693099 6043 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:42.699980 5389 catalog_manager.cc:5495] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:42.708042 6043 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:42.713424 5827 tablet_bootstrap.cc:492] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:42.713877 5827 ts_tablet_manager.cc:1397] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.155s user 0.011s sys 0.004s
I20260807 13:32:42.714869 5830 tablet_bootstrap.cc:654] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.722064 5827 raft_consensus.cc:348] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.723384 5827 raft_consensus.cc:374] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.723755 5827 raft_consensus.cc:729] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.724604 5827 consensus_queue.cc:260] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.727939 6043 consensus_queue.cc:1035] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:42.729310 5771 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:42.748898 5827 ts_tablet_manager.cc:1428] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.035s user 0.007s sys 0.001s
I20260807 13:32:42.749763 5827 tablet_bootstrap.cc:492] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:42.777565 5839 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.778313 5839 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.780500 6002 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:42.781713 5828 tablet_bootstrap.cc:492] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:42.782217 5828 ts_tablet_manager.cc:1397] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.205s user 0.014s sys 0.033s
I20260807 13:32:42.785923 5828 raft_consensus.cc:348] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.786725 5828 raft_consensus.cc:374] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.787060 5828 raft_consensus.cc:729] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.791563 5828 consensus_queue.cc:260] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.792696 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:42.793958 5828 ts_tablet_manager.cc:1428] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.011s user 0.005s sys 0.003s
I20260807 13:32:42.795029 5828 tablet_bootstrap.cc:492] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:42.796041 6043 consensus_queue.cc:1035] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:42.808473 6002 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.809412 6002 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.803772 5839 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:42.813514 6002 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.820564 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:42.824509 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:42.825884 5827 tablet_bootstrap.cc:654] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:42.826234 5620 leader_election.cc:341] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:42.828351 5618 leader_election.cc:341] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.829164 5618 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:42.831322 6002 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:42.831851 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:42.841156 5828 tablet_bootstrap.cc:654] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.840579 5721 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:42.857999 5830 tablet_bootstrap.cc:492] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:42.860713 5830 ts_tablet_manager.cc:1397] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.175s user 0.008s sys 0.017s
I20260807 13:32:42.865727 5957 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:32:42.868793 5830 raft_consensus.cc:348] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.869656 5830 raft_consensus.cc:374] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.870002 5830 raft_consensus.cc:729] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.871281 5830 consensus_queue.cc:260] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.878201 5830 ts_tablet_manager.cc:1428] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.017s user 0.005s sys 0.003s
I20260807 13:32:42.879186 5830 tablet_bootstrap.cc:492] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159: Bootstrap starting.
W20260807 13:32:42.884469 5620 consensus_peers.cc:487] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:42.895644 5827 tablet_bootstrap.cc:492] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:42.896082 5827 ts_tablet_manager.cc:1397] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.146s user 0.015s sys 0.003s
I20260807 13:32:42.902940 5828 tablet_bootstrap.cc:492] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:42.903474 5828 ts_tablet_manager.cc:1397] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.109s user 0.019s sys 0.034s
I20260807 13:32:42.905534 5827 raft_consensus.cc:348] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.907809 5827 raft_consensus.cc:374] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.908087 5827 raft_consensus.cc:729] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.927040 5830 tablet_bootstrap.cc:654] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.928848 5828 raft_consensus.cc:348] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.930022 5828 raft_consensus.cc:374] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.930447 5828 raft_consensus.cc:729] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.931376 5828 consensus_queue.cc:260] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.933790 5828 ts_tablet_manager.cc:1428] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.030s user 0.002s sys 0.011s
I20260807 13:32:42.934916 5828 tablet_bootstrap.cc:492] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:42.938458 5827 consensus_queue.cc:260] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.942606 5920 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:42.943418 5920 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.949249 5920 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:42.950096 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:42.953155 5666 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:42.955296 5499 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:42.956292 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:42.957892 5869 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:42.958438 5869 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:42.959008 5869 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:42.963016 5501 leader_election.cc:341] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:42.964632 5827 ts_tablet_manager.cc:1428] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.068s user 0.008s sys 0.000s
I20260807 13:32:42.967753 5827 tablet_bootstrap.cc:492] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
W20260807 13:32:42.969926 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:42.977347 5828 tablet_bootstrap.cc:654] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:42.980289 5830 tablet_bootstrap.cc:492] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:42.980707 5830 ts_tablet_manager.cc:1397] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.102s user 0.027s sys 0.033s
I20260807 13:32:42.985261 5830 raft_consensus.cc:348] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.986272 5830 raft_consensus.cc:374] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:42.986614 5830 raft_consensus.cc:729] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:42.989492 5869 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.990432 5830 consensus_queue.cc:260] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:42.991222 5828 tablet_bootstrap.cc:492] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:42.991750 5828 ts_tablet_manager.cc:1397] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.015s
I20260807 13:32:42.993686 5830 ts_tablet_manager.cc:1428] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.013s user 0.004s sys 0.009s
I20260807 13:32:42.994724 5830 tablet_bootstrap.cc:492] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:42.999642 5828 raft_consensus.cc:348] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.000268 5828 raft_consensus.cc:374] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.000509 5828 raft_consensus.cc:729] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.001201 5828 consensus_queue.cc:260] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.004839 5830 tablet_bootstrap.cc:654] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.015297 5828 ts_tablet_manager.cc:1428] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260807 13:32:43.016934 5828 tablet_bootstrap.cc:492] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:43.022606 5827 tablet_bootstrap.cc:654] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.025660 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:43.023545 5869 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.029183 5666 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.027772 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:43.032835 5769 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.032895 5869 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.033816 5869 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.034981 5828 tablet_bootstrap.cc:654] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.050927 5869 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.052858 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:43.053876 5771 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:43.055794 5501 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:43.057112 6041 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:43.057713 6041 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:43.058313 6041 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.062590 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:43.063781 5667 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:43.072197 5666 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:43.074906 5499 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:43.077373 5919 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:43.082473 5869 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:43.090134 5869 raft_consensus.cc:686] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:43.091137 5771 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.094120 5920 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.095024 5920 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.091885 5869 consensus_queue.cc:237] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.105077 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:43.105650 5920 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.107169 5827 tablet_bootstrap.cc:492] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:43.107621 5827 ts_tablet_manager.cc:1397] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.140s user 0.028s sys 0.036s
I20260807 13:32:43.107898 5830 tablet_bootstrap.cc:492] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:43.108415 5830 ts_tablet_manager.cc:1397] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.114s user 0.014s sys 0.007s
I20260807 13:32:43.109526 5666 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:43.113094 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:43.114979 5499 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:43.117172 5837 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:43.117862 5837 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:43.118577 5837 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.125294 5830 raft_consensus.cc:348] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.126232 5830 raft_consensus.cc:374] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.126560 5830 raft_consensus.cc:729] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.127370 5830 consensus_queue.cc:260] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.131793 5770 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:43.132128 5827 raft_consensus.cc:348] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.135195 5828 tablet_bootstrap.cc:492] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:43.148357 5769 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:43.157748 6041 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.160524 5828 ts_tablet_manager.cc:1397] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.134s user 0.026s sys 0.031s
I20260807 13:32:43.162338 5919 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:43.164386 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:43.165169 5666 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.165684 5828 raft_consensus.cc:348] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.166424 5828 raft_consensus.cc:374] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.166725 5828 raft_consensus.cc:729] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.168071 6041 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.155139 5830 ts_tablet_manager.cc:1428] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.046s user 0.009s sys 0.001s
I20260807 13:32:43.170526 5830 tablet_bootstrap.cc:492] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:43.155426 5827 raft_consensus.cc:374] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.172065 5827 raft_consensus.cc:729] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.172827 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:43.173460 5957 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.172968 5827 consensus_queue.cc:260] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.174238 5957 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.177696 5957 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:43.174258 5771 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.179754 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:43.180728 5667 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:43.156286 5920 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:43.182318 5721 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:43.182772 6043 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:43.157050 5837 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.168948 5828 consensus_queue.cc:260] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.185850 5837 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.186348 5839 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:32:43.186830 5839 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:43.186489 5828 ts_tablet_manager.cc:1428] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.026s user 0.008s sys 0.000s
I20260807 13:32:43.187858 5828 tablet_bootstrap.cc:492] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:43.187434 5839 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:43.189888 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:43.190501 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:43.190704 5770 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.201411 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:43.201999 5663 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.204077 5390 catalog_manager.cc:5495] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:43.214293 5827 ts_tablet_manager.cc:1428] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.106s user 0.015s sys 0.001s
I20260807 13:32:43.215272 5827 tablet_bootstrap.cc:492] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:43.224757 5919 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.225281 5919 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.228426 5919 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.229861 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:43.230527 5828 tablet_bootstrap.cc:654] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.236011 5770 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:43.237917 5830 tablet_bootstrap.cc:654] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:43.239261 5620 leader_election.cc:341] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.242892 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:43.243901 5663 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:43.245420 5499 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:43.246565 6043 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:43.247077 6043 raft_consensus.cc:686] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:43.246367 5839 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.247249 5771 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
W20260807 13:32:43.251952 5618 leader_election.cc:341] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.252487 5618 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:43.252103 6043 consensus_queue.cc:237] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.252616 5666 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:43.258520 5499 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:43.258909 5938 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:43.259382 6088 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:43.259895 6088 raft_consensus.cc:686] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:43.261438 6088 consensus_queue.cc:237] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.263967 5770 raft_consensus.cc:1226] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260807 13:32:43.264319 5839 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:43.267912 5827 tablet_bootstrap.cc:654] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.277671 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:43.280673 5920 consensus_queue.cc:1046] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:43.282179 5920 raft_consensus.cc:3032] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:32:43.282823 5920 raft_consensus.cc:729] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:43.284207 5920 consensus_queue.cc:260] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.286537 5920 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:32:43.310961 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 69039.6us
I20260807 13:32:43.318706 5828 tablet_bootstrap.cc:492] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:43.319175 5828 ts_tablet_manager.cc:1397] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.131s user 0.029s sys 0.024s
I20260807 13:32:43.330230 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:43.343915 5555 raft_consensus.cc:2396] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:32:43.343569 5828 raft_consensus.cc:348] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.346711 5828 raft_consensus.cc:374] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.347478 5828 raft_consensus.cc:729] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.348294 5722 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:43.348671 5828 consensus_queue.cc:260] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.350955 6094 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:32:43.353958 5828 ts_tablet_manager.cc:1428] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.035s user 0.004s sys 0.005s
I20260807 13:32:43.354063 5830 tablet_bootstrap.cc:492] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:43.354548 5830 ts_tablet_manager.cc:1397] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.184s user 0.006s sys 0.018s
I20260807 13:32:43.355099 5828 tablet_bootstrap.cc:492] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:43.360541 5830 raft_consensus.cc:348] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.361649 5830 raft_consensus.cc:374] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.361937 5830 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.363018 5827 tablet_bootstrap.cc:492] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:43.362703 5830 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.363428 5827 ts_tablet_manager.cc:1397] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.148s user 0.016s sys 0.001s
I20260807 13:32:43.365206 5830 ts_tablet_manager.cc:1428] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 13:32:43.366195 5830 tablet_bootstrap.cc:492] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:43.366478 5828 tablet_bootstrap.cc:654] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.367290 5920 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.367998 5920 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.370302 5827 raft_consensus.cc:348] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.373332 5827 raft_consensus.cc:374] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.373656 5827 raft_consensus.cc:729] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.372797 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:43.373414 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:43.374460 5667 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
W20260807 13:32:43.375593 5501 leader_election.cc:341] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.373610 5920 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.376399 5827 consensus_queue.cc:260] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.385969 5830 tablet_bootstrap.cc:654] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.386627 5827 ts_tablet_manager.cc:1428] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.023s user 0.010s sys 0.000s
I20260807 13:32:43.387670 5827 tablet_bootstrap.cc:492] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:43.382470 5499 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:43.390285 6088 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:43.390863 6088 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:43.391517 6088 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.404673 5919 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.405369 5919 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.417047 5919 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.417047 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:43.425328 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:43.425956 5618 leader_election.cc:341] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:43.427908 5620 leader_election.cc:341] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.428567 5620 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:43.429189 5827 tablet_bootstrap.cc:654] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.431563 5938 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:43.438912 5770 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.440440 5830 tablet_bootstrap.cc:492] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:43.440974 5830 ts_tablet_manager.cc:1397] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.075s user 0.012s sys 0.010s
I20260807 13:32:43.448701 5830 raft_consensus.cc:348] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.449476 5830 raft_consensus.cc:374] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.449760 5830 raft_consensus.cc:729] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.450515 5830 consensus_queue.cc:260] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.453053 5830 ts_tablet_manager.cc:1428] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260807 13:32:43.454964 6088 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.457615 6088 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.464977 5830 tablet_bootstrap.cc:492] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:43.471321 5828 tablet_bootstrap.cc:492] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:43.471801 5828 ts_tablet_manager.cc:1397] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.117s user 0.029s sys 0.014s
I20260807 13:32:43.475518 5828 raft_consensus.cc:348] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.476554 5828 raft_consensus.cc:374] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.476938 5828 raft_consensus.cc:729] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.464493 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:43.478322 5828 consensus_queue.cc:260] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.478771 5666 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.482090 5828 ts_tablet_manager.cc:1428] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.010s user 0.007s sys 0.001s
I20260807 13:32:43.494619 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:43.496587 5501 leader_election.cc:341] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.514040 5828 tablet_bootstrap.cc:492] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:43.514634 5830 tablet_bootstrap.cc:654] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.515232 5827 tablet_bootstrap.cc:492] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:43.515753 5827 ts_tablet_manager.cc:1397] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.128s user 0.050s sys 0.037s
I20260807 13:32:43.500523 5666 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:43.476830 5389 catalog_manager.cc:5495] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:43.523339 5827 raft_consensus.cc:348] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.524025 5827 raft_consensus.cc:374] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.524292 5827 raft_consensus.cc:729] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.523561 5389 catalog_manager.cc:5495] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:43.526846 5499 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:43.528627 5920 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:43.529412 5920 raft_consensus.cc:686] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:43.530918 5920 consensus_queue.cc:237] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.532145 5828 tablet_bootstrap.cc:654] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.537225 5830 tablet_bootstrap.cc:492] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:43.537729 5830 ts_tablet_manager.cc:1397] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.073s user 0.012s sys 0.012s
I20260807 13:32:43.538215 5827 consensus_queue.cc:260] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.540488 5827 ts_tablet_manager.cc:1428] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260807 13:32:43.541409 5827 tablet_bootstrap.cc:492] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:43.542863 5830 raft_consensus.cc:348] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.543740 5830 raft_consensus.cc:374] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.544067 5830 raft_consensus.cc:729] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.544893 5830 consensus_queue.cc:260] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.548202 6043 consensus_queue.cc:1035] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:43.549546 5830 ts_tablet_manager.cc:1428] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.012s user 0.004s sys 0.004s
I20260807 13:32:43.552554 5827 tablet_bootstrap.cc:654] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.555222 5830 tablet_bootstrap.cc:492] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:43.559314 5828 tablet_bootstrap.cc:492] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:43.559854 5828 ts_tablet_manager.cc:1397] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.008s
I20260807 13:32:43.586855 5828 raft_consensus.cc:348] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.587670 5828 raft_consensus.cc:374] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.588003 5828 raft_consensus.cc:729] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.588675 5828 consensus_queue.cc:260] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.606875 5830 tablet_bootstrap.cc:654] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.609375 5828 ts_tablet_manager.cc:1428] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.049s user 0.015s sys 0.014s
I20260807 13:32:43.613142 5828 tablet_bootstrap.cc:492] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:43.620251 6043 consensus_queue.cc:1035] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:43.640691 6094 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.641572 5827 tablet_bootstrap.cc:492] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:43.641156 6094 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.642037 5827 ts_tablet_manager.cc:1397] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.101s user 0.028s sys 0.020s
I20260807 13:32:43.643852 5828 tablet_bootstrap.cc:654] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.644308 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:43.644486 5827 raft_consensus.cc:348] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.645123 5827 raft_consensus.cc:374] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.645042 5667 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:43.645462 5827 raft_consensus.cc:729] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.646128 5827 consensus_queue.cc:260] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.646606 5721 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:43.648203 5827 ts_tablet_manager.cc:1428] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 13:32:43.648267 6093 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:43.648693 6093 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:43.648994 6093 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.649161 5827 tablet_bootstrap.cc:492] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:43.653064 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:43.653376 5830 tablet_bootstrap.cc:492] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:43.653862 5830 ts_tablet_manager.cc:1397] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.099s user 0.019s sys 0.028s
W20260807 13:32:43.655817 5722 leader_election.cc:341] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.656217 5830 raft_consensus.cc:348] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.656855 5830 raft_consensus.cc:374] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.657128 5830 raft_consensus.cc:729] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.661805 5827 tablet_bootstrap.cc:654] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.666991 5837 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.674759 6094 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:43.674939 5837 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.676373 6093 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.679930 5837 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.657732 5830 consensus_queue.cc:260] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.661844 5828 tablet_bootstrap.cc:492] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:43.680873 5828 ts_tablet_manager.cc:1397] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.070s user 0.017s sys 0.000s
I20260807 13:32:43.682057 5830 ts_tablet_manager.cc:1428] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20260807 13:32:43.682937 5830 tablet_bootstrap.cc:492] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:43.683131 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:43.683167 5828 raft_consensus.cc:348] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.684003 5828 raft_consensus.cc:374] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.684284 5828 raft_consensus.cc:729] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.684850 5828 consensus_queue.cc:260] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.686216 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:43.687232 5828 ts_tablet_manager.cc:1428] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260807 13:32:43.687534 5499 leader_election.cc:341] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.688401 5828 tablet_bootstrap.cc:492] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
W20260807 13:32:43.689122 5722 leader_election.cc:341] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.692979 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:43.694060 5771 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:43.695238 6093 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:43.697319 5501 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:43.697503 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:43.698256 5837 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:43.698371 5667 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.698750 5837 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:43.699299 5837 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.699657 5830 tablet_bootstrap.cc:654] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.701555 5389 catalog_manager.cc:5495] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:43.708355 6093 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.712136 6093 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.735103 5828 tablet_bootstrap.cc:654] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.737350 5837 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.740741 5667 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:43.741408 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:43.742314 5663 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:43.744160 5721 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:43.746356 6094 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:43.747087 6094 raft_consensus.cc:686] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:43.748333 6094 consensus_queue.cc:237] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.745919 5721 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:43.751463 5957 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:43.751890 5957 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:43.752352 5957 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.754354 5837 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.761574 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:43.765793 6043 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.769389 6043 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.773351 6043 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.778565 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:43.781623 6093 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:43.786687 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:43.787727 5770 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:43.788228 5499 leader_election.cc:341] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.792659 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:43.792377 6043 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:43.793630 5667 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:43.794987 5499 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:43.796020 6041 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:43.796428 6041 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:43.796823 6041 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:43.806391 5722 leader_election.cc:341] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.808750 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:43.820942 6088 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:43.821123 5920 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:32:43.827587 5501 leader_election.cc:341] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.837294 5827 tablet_bootstrap.cc:492] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:43.838069 5827 ts_tablet_manager.cc:1397] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.189s user 0.024s sys 0.028s
I20260807 13:32:43.833148 5957 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.859959 5919 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:43.867139 5827 raft_consensus.cc:348] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.867895 5827 raft_consensus.cc:374] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.868196 5827 raft_consensus.cc:729] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.868799 5827 consensus_queue.cc:260] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.871521 5827 ts_tablet_manager.cc:1428] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.033s user 0.002s sys 0.005s
I20260807 13:32:43.869272 5770 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:43.877332 5827 tablet_bootstrap.cc:492] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:43.860420 5919 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.876392 5957 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:43.889166 5828 tablet_bootstrap.cc:492] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:43.889209 5830 tablet_bootstrap.cc:492] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:43.889657 5828 ts_tablet_manager.cc:1397] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.202s user 0.021s sys 0.020s
I20260807 13:32:43.889663 5830 ts_tablet_manager.cc:1397] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.207s user 0.012s sys 0.023s
I20260807 13:32:43.891233 6041 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.890882 5389 catalog_manager.cc:5495] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:43.896811 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:43.936753 5827 tablet_bootstrap.cc:654] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.936611 6041 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.937815 5919 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:43.940912 5828 raft_consensus.cc:348] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.941622 5828 raft_consensus.cc:374] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.941841 5828 raft_consensus.cc:729] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.931828 5501 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:43.946499 5828 consensus_queue.cc:260] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.952924 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:43.956483 6143 log.cc:924] Time spent T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260807 13:32:43.958001 5828 ts_tablet_manager.cc:1428] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.068s user 0.005s sys 0.001s
I20260807 13:32:43.958411 5830 raft_consensus.cc:348] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.959069 5828 tablet_bootstrap.cc:492] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:43.959240 5830 raft_consensus.cc:374] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:43.959570 5830 raft_consensus.cc:729] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:43.960237 5830 consensus_queue.cc:260] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.948066 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:32:43.962673 5722 leader_election.cc:341] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.962852 5666 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.963812 5830 ts_tablet_manager.cc:1428] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.074s user 0.009s sys 0.000s
I20260807 13:32:43.965207 5830 tablet_bootstrap.cc:492] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:43.950865 6041 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:43.967096 6041 raft_consensus.cc:686] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:43.973979 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:43.974537 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:43.976135 5620 leader_election.cc:341] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:43.968400 6041 consensus_queue.cc:237] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:43.978765 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:43.980791 5665 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:43.989607 5666 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:43.989966 5828 tablet_bootstrap.cc:654] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.991050 5830 tablet_bootstrap.cc:654] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:43.992875 5721 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:43.999197 5957 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:44.000186 5957 raft_consensus.cc:686] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:44.000737 5837 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:44.000957 5957 consensus_queue.cc:237] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:44.004069 5501 leader_election.cc:341] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:44.005832 5618 leader_election.cc:341] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.006424 5618 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:44.007264 6002 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:44.044598 5920 consensus_queue.cc:1035] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:44.075008 5919 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.075582 5920 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.079967 5919 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.102288 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:44.105834 5620 leader_election.cc:341] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.097842 5389 catalog_manager.cc:5495] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:44.108022 5919 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.101991 5828 tablet_bootstrap.cc:492] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:44.112257 5394 catalog_manager.cc:5495] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:44.113427 5828 ts_tablet_manager.cc:1397] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.154s user 0.004s sys 0.010s
I20260807 13:32:44.116595 5830 tablet_bootstrap.cc:492] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:44.117127 5830 ts_tablet_manager.cc:1397] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.152s user 0.013s sys 0.015s
W20260807 13:32:44.094702 5501 consensus_peers.cc:487] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:44.126397 5827 tablet_bootstrap.cc:492] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:44.126806 5827 ts_tablet_manager.cc:1397] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.250s user 0.028s sys 0.042s
I20260807 13:32:44.130329 5665 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:44.082962 5920 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.135887 5499 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:44.137642 6152 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:44.153143 5828 raft_consensus.cc:348] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.141446 6152 raft_consensus.cc:686] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:44.154086 5828 raft_consensus.cc:374] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.162979 5828 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.162329 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:44.161824 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:44.202193 6152 consensus_queue.cc:237] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.218562 5920 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.219630 5828 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.223764 5827 raft_consensus.cc:348] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.237010 5827 raft_consensus.cc:374] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.237423 5827 raft_consensus.cc:729] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.225138 5828 ts_tablet_manager.cc:1428] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.109s user 0.008s sys 0.007s
I20260807 13:32:44.225793 5830 raft_consensus.cc:348] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.231479 5837 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:32:44.233933 5618 leader_election.cc:341] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.242851 5830 raft_consensus.cc:374] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.243700 5830 raft_consensus.cc:729] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.243237 5618 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:44.244597 5827 consensus_queue.cc:260] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.242990 5837 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:44.249852 5722 consensus_peers.cc:487] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 -> Peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Couldn't send request to peer 14f62bf285c448b9b7a21fabd7a5f0bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:44.247285 5830 consensus_queue.cc:260] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.252391 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:44.251453 5837 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.255110 5830 ts_tablet_manager.cc:1428] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.138s user 0.005s sys 0.005s
I20260807 13:32:44.255995 5830 tablet_bootstrap.cc:492] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:44.261619 5919 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:44.261596 5827 ts_tablet_manager.cc:1428] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.135s user 0.020s sys 0.010s
I20260807 13:32:44.264019 5827 tablet_bootstrap.cc:492] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:44.267186 5957 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.267658 5957 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.271310 5957 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:32:44.271724 5499 leader_election.cc:341] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.273793 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:44.238854 5828 tablet_bootstrap.cc:492] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:44.286737 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:44.288882 5722 leader_election.cc:341] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.288825 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:44.292646 5499 leader_election.cc:341] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.297966 5827 tablet_bootstrap.cc:654] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:44.305383 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:44.308197 5830 tablet_bootstrap.cc:654] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:44.301348 5391 catalog_manager.cc:5495] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:44.310063 5828 tablet_bootstrap.cc:654] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:44.320755 5501 leader_election.cc:341] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.313549 5957 consensus_queue.cc:1035] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:44.323285 6093 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.327901 5501 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:44.329666 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:44.333302 5662 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:44.332588 6093 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.343036 5721 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:44.343940 6093 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:44.345139 6093 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:44.345736 6093 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:44.346387 5830 tablet_bootstrap.cc:492] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:44.346370 6093 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:44.346985 5830 ts_tablet_manager.cc:1397] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.091s user 0.013s sys 0.013s
I20260807 13:32:44.354000 6152 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:44.356838 5830 raft_consensus.cc:348] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.357666 5830 raft_consensus.cc:374] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.357990 5830 raft_consensus.cc:729] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.358292 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:44.358829 5830 consensus_queue.cc:260] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.359155 5667 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:44.361435 5830 ts_tablet_manager.cc:1428] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.014s user 0.004s sys 0.002s
I20260807 13:32:44.361367 5721 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:44.362413 5830 tablet_bootstrap.cc:492] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159: Bootstrap starting.
W20260807 13:32:44.363590 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 50308.5us
I20260807 13:32:44.364225 5957 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:44.364871 5957 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:44.365440 5828 tablet_bootstrap.cc:492] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:44.365602 5957 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:44.365975 5828 ts_tablet_manager.cc:1397] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.127s user 0.013s sys 0.012s
I20260807 13:32:44.376861 5828 raft_consensus.cc:348] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.377890 5828 raft_consensus.cc:374] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:32:44.373368 5501 leader_election.cc:341] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.378275 5828 raft_consensus.cc:729] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.382505 5501 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:44.382879 5828 consensus_queue.cc:260] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.386129 5828 ts_tablet_manager.cc:1428] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.013s user 0.005s sys 0.002s
I20260807 13:32:44.387392 6152 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:44.388162 5828 tablet_bootstrap.cc:492] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:44.395335 5830 tablet_bootstrap.cc:654] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:44.369983 6093 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.402565 5828 tablet_bootstrap.cc:654] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:44.405905 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:44.405571 5957 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.427238 6093 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:44.435791 6160 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.452111 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:44.466085 5957 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:44.466554 5827 tablet_bootstrap.cc:492] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:44.466816 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:44.539462 6094 consensus_queue.cc:1035] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260807 13:32:44.556389 5722 leader_election.cc:341] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.563210 6160 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.479737 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:44.566744 5665 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:44.569712 5827 ts_tablet_manager.cc:1397] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.306s user 0.024s sys 0.057s
I20260807 13:32:44.570948 5830 tablet_bootstrap.cc:492] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:44.571463 5830 ts_tablet_manager.cc:1397] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.209s user 0.028s sys 0.013s
W20260807 13:32:44.568787 5722 leader_election.cc:341] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.490990 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:44.572803 5660 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:44.574841 5920 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.576764 5828 tablet_bootstrap.cc:492] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:44.577330 5828 ts_tablet_manager.cc:1397] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.190s user 0.017s sys 0.043s
I20260807 13:32:44.515777 5938 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.575646 5920 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.582326 5830 raft_consensus.cc:348] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.583133 5830 raft_consensus.cc:374] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.582657 5828 raft_consensus.cc:348] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.583606 5828 raft_consensus.cc:374] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.583935 5828 raft_consensus.cc:729] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.583483 5830 raft_consensus.cc:729] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.581241 5938 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.588976 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:44.591010 6160 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.585449 5920 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.589931 5666 raft_consensus.cc:2454] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:44.587283 5830 consensus_queue.cc:260] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.595759 5830 ts_tablet_manager.cc:1428] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.024s user 0.005s sys 0.003s
I20260807 13:32:44.589326 5938 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.597180 5828 consensus_queue.cc:260] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:44.601933 5722 leader_election.cc:341] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.602474 5661 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:44.605767 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:44.607125 5769 raft_consensus.cc:2379] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 1: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:32:44.596397 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:44.614240 5830 tablet_bootstrap.cc:492] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:44.617579 5827 raft_consensus.cc:348] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.618235 5827 raft_consensus.cc:374] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.618498 5827 raft_consensus.cc:729] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.619045 5827 consensus_queue.cc:260] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.623797 5828 ts_tablet_manager.cc:1428] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.046s user 0.006s sys 0.002s
I20260807 13:32:44.624680 5828 tablet_bootstrap.cc:492] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:44.634042 5827 ts_tablet_manager.cc:1428] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.064s user 0.007s sys 0.000s
I20260807 13:32:44.635308 5827 tablet_bootstrap.cc:492] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:44.635963 5499 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:44.649718 5837 raft_consensus.cc:2781] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:44.650285 5837 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:44.650326 5665 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:44.650883 5837 raft_consensus.cc:3037] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:44.662212 5721 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:44.663347 6094 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:44.663981 6094 raft_consensus.cc:686] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:44.664994 6094 consensus_queue.cc:237] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.665782 5828 tablet_bootstrap.cc:654] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:44.674458 5660 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:44.678719 6043 consensus_queue.cc:1035] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:44.682425 5837 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.682950 5721 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:44.686434 6043 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:32:44.655915 5620 leader_election.cc:341] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.694947 5837 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.698776 6172 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:44.699716 6172 raft_consensus.cc:686] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:44.700065 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:44.702283 5722 consensus_peers.cc:487] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 -> Peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Couldn't send request to peer 14f62bf285c448b9b7a21fabd7a5f0bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:44.696300 6043 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.708272 6043 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.712461 5830 tablet_bootstrap.cc:654] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:44.701164 6172 consensus_queue.cc:237] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.728150 5828 tablet_bootstrap.cc:492] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:44.728559 5828 ts_tablet_manager.cc:1397] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.104s user 0.009s sys 0.009s
I20260807 13:32:44.729955 5830 tablet_bootstrap.cc:492] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:44.730515 5830 ts_tablet_manager.cc:1397] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.119s user 0.007s sys 0.009s
I20260807 13:32:44.732180 5827 tablet_bootstrap.cc:654] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:44.731959 5828 raft_consensus.cc:348] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.732633 5828 raft_consensus.cc:374] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.732864 5828 raft_consensus.cc:729] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.774451 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:44.782652 5938 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:32:44.775185 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:44.776638 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:44.779946 5919 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.783907 5938 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:44.774010 5501 leader_election.cc:341] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.784925 5919 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.787956 5919 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.788646 5938 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.791776 5828 consensus_queue.cc:260] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.797015 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:44.799754 6043 consensus_queue.cc:1035] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:44.823506 5618 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:44.824796 5938 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:44.827595 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:44.829393 5618 leader_election.cc:341] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.829912 5618 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:44.830960 6160 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:44.836805 5390 catalog_manager.cc:5495] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:44.840597 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:44.841681 5660 raft_consensus.cc:3037] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:44.850800 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:44.851989 5556 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:32:44.853559 6172 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.815796 5828 ts_tablet_manager.cc:1428] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.087s user 0.006s sys 0.005s
I20260807 13:32:44.860163 5828 tablet_bootstrap.cc:492] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:44.849381 5830 raft_consensus.cc:348] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.864763 5830 raft_consensus.cc:374] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.867961 5830 raft_consensus.cc:729] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.863235 6172 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.868862 5830 consensus_queue.cc:260] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:44.872937 5501 leader_election.cc:341] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:44.873847 5501 leader_election.cc:341] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:44.878481 5618 leader_election.cc:341] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.878966 5618 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:44.879863 6160 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:32:44.880321 6160 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:32:44.881115 6172 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:44.881294 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:44.888617 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:44.899048 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:44.901052 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:44.908455 5771 raft_consensus.cc:2379] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:44.911688 5389 catalog_manager.cc:5495] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:44.921394 5827 tablet_bootstrap.cc:492] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:44.922276 5827 ts_tablet_manager.cc:1397] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.287s user 0.029s sys 0.062s
I20260807 13:32:44.881140 6160 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:32:44.927857 5767 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:44.930641 6176 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.931269 6176 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:44.937371 5499 leader_election.cc:341] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.937879 5499 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:44.939848 5830 ts_tablet_manager.cc:1428] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.209s user 0.004s sys 0.006s
I20260807 13:32:44.942160 6176 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:44.944160 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:44.946336 6190 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:44.948876 5827 raft_consensus.cc:348] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.949772 5827 raft_consensus.cc:374] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:44.950088 5827 raft_consensus.cc:729] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:44.950260 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:44.950702 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:44.951215 5661 raft_consensus.cc:2379] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 1: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:32:44.950958 5827 consensus_queue.cc:260] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.954434 5919 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:44.954919 5919 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.955205 5721 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:44.956200 6094 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:44.958041 5919 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.958410 5721 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:44.960183 5828 tablet_bootstrap.cc:654] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:44.960023 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:44.961469 5618 leader_election.cc:341] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.962661 5830 tablet_bootstrap.cc:492] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:44.978340 6094 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:44.973011 5827 ts_tablet_manager.cc:1428] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.050s user 0.007s sys 0.000s
I20260807 13:32:44.979665 6043 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:32:44.982203 5620 leader_election.cc:341] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:44.984069 6160 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:44.985639 5660 raft_consensus.cc:2454] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:44.986083 6160 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:44.988372 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:44.989133 5827 tablet_bootstrap.cc:492] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:44.997562 5830 tablet_bootstrap.cc:654] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:44.982662 5620 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:44.999819 6160 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:45.004309 5828 tablet_bootstrap.cc:492] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:45.004782 5828 ts_tablet_manager.cc:1397] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.145s user 0.018s sys 0.011s
I20260807 13:32:45.005890 5553 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:32:45.009505 5618 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:45.011368 6160 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:32:45.013721 6160 raft_consensus.cc:686] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:45.014873 6160 consensus_queue.cc:237] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.009158 6043 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260807 13:32:45.016436 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.023669 5828 raft_consensus.cc:348] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.024370 5828 raft_consensus.cc:374] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.024623 5828 raft_consensus.cc:729] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.025238 5828 consensus_queue.cc:260] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.027151 5827 tablet_bootstrap.cc:654] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.027154 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:45.028158 5770 raft_consensus.cc:2379] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:45.029510 5499 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:45.030802 6043 raft_consensus.cc:2781] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:45.031239 6043 raft_consensus.cc:686] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:45.032055 6043 consensus_queue.cc:237] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.039302 5919 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.039801 5919 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.041719 5919 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.042358 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:45.043603 5618 leader_election.cc:341] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.048362 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:45.055491 5620 leader_election.cc:341] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.065201 5620 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:45.066075 5938 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:45.066233 5828 ts_tablet_manager.cc:1428] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.061s user 0.006s sys 0.004s
I20260807 13:32:45.067318 5828 tablet_bootstrap.cc:492] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:45.069934 5390 catalog_manager.cc:5495] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:45.069828 5389 catalog_manager.cc:5495] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
W20260807 13:32:45.073326 5620 leader_election.cc:341] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.074237 5828 tablet_bootstrap.cc:654] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.074477 5620 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:45.075455 5938 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:45.076790 5830 tablet_bootstrap.cc:492] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:45.077206 5830 ts_tablet_manager.cc:1397] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.115s user 0.012s sys 0.022s
I20260807 13:32:45.088950 5830 raft_consensus.cc:348] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.089658 5830 raft_consensus.cc:374] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.089915 5830 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.090528 5830 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.093127 5830 ts_tablet_manager.cc:1428] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20260807 13:32:45.096454 5830 tablet_bootstrap.cc:492] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:45.104581 5827 tablet_bootstrap.cc:492] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:45.104943 5828 tablet_bootstrap.cc:492] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:45.105064 5827 ts_tablet_manager.cc:1397] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.116s user 0.011s sys 0.011s
I20260807 13:32:45.105422 5828 ts_tablet_manager.cc:1397] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.015s
I20260807 13:32:45.107556 5827 raft_consensus.cc:348] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.108314 5828 raft_consensus.cc:348] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.108799 5827 raft_consensus.cc:374] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.108982 5828 raft_consensus.cc:374] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.109970 5830 tablet_bootstrap.cc:654] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.111169 5828 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.112314 5828 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.111177 5827 raft_consensus.cc:729] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.113405 6176 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.114213 5828 ts_tablet_manager.cc:1428] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.009s user 0.002s sys 0.004s
I20260807 13:32:45.113868 6176 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.113270 5827 consensus_queue.cc:260] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.115842 6176 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:45.116776 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:45.116904 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:45.117568 5553 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:45.118363 5827 ts_tablet_manager.cc:1428] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.013s user 0.006s sys 0.001s
W20260807 13:32:45.118794 5721 leader_election.cc:341] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.126485 5828 tablet_bootstrap.cc:492] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:45.127452 5827 tablet_bootstrap.cc:492] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:45.128587 5722 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:45.129951 6176 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:45.130339 6176 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:45.130708 6176 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.131839 5770 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.133210 5828 tablet_bootstrap.cc:654] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.133929 5827 tablet_bootstrap.cc:654] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.137920 6176 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.143775 5830 tablet_bootstrap.cc:492] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:45.145183 5830 ts_tablet_manager.cc:1397] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.005s
I20260807 13:32:45.145877 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:45.148384 5830 raft_consensus.cc:348] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.149084 5830 raft_consensus.cc:374] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.149348 5830 raft_consensus.cc:729] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.149941 5830 consensus_queue.cc:260] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.152120 5830 ts_tablet_manager.cc:1428] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 13:32:45.152653 6176 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:45.157203 5827 tablet_bootstrap.cc:492] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:45.157619 5827 ts_tablet_manager.cc:1397] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.004s
W20260807 13:32:45.157696 5721 leader_election.cc:341] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.151017 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:45.158882 5553 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.159168 5830 tablet_bootstrap.cc:492] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:45.160069 5827 raft_consensus.cc:348] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.160686 5827 raft_consensus.cc:374] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.160912 5827 raft_consensus.cc:729] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.161423 5827 consensus_queue.cc:260] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.166945 5830 tablet_bootstrap.cc:654] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.167980 5827 ts_tablet_manager.cc:1428] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.010s user 0.003s sys 0.003s
I20260807 13:32:45.168469 5828 tablet_bootstrap.cc:492] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:45.168982 5827 tablet_bootstrap.cc:492] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:45.178360 5828 ts_tablet_manager.cc:1397] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.063s user 0.015s sys 0.026s
I20260807 13:32:45.182029 5554 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.182070 5828 raft_consensus.cc:348] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.182930 5828 raft_consensus.cc:374] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.183176 5828 raft_consensus.cc:729] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.183837 5828 consensus_queue.cc:260] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.185827 5828 ts_tablet_manager.cc:1428] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.007s user 0.002s sys 0.002s
I20260807 13:32:45.187258 5828 tablet_bootstrap.cc:492] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:45.195549 5828 tablet_bootstrap.cc:654] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.196843 5827 tablet_bootstrap.cc:654] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.209935 5828 tablet_bootstrap.cc:492] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:45.210382 5828 ts_tablet_manager.cc:1397] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.006s
I20260807 13:32:45.198644 5938 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.211354 5938 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.213320 5938 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.213156 5828 raft_consensus.cc:348] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.213867 5828 raft_consensus.cc:374] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.214161 5828 raft_consensus.cc:729] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.214774 5828 consensus_queue.cc:260] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.217026 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.217028 5828 ts_tablet_manager.cc:1428] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260807 13:32:45.221033 5827 tablet_bootstrap.cc:492] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:45.221478 5827 ts_tablet_manager.cc:1397] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.053s user 0.013s sys 0.001s
I20260807 13:32:45.221560 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:45.222259 5620 leader_election.cc:341] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.222337 5554 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:45.221067 5828 tablet_bootstrap.cc:492] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:45.223448 6176 consensus_queue.cc:1035] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:45.223941 5827 raft_consensus.cc:348] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.224865 5827 raft_consensus.cc:374] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.225208 5827 raft_consensus.cc:729] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.226019 5827 consensus_queue.cc:260] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.228420 5827 ts_tablet_manager.cc:1428] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:32:45.229512 5827 tablet_bootstrap.cc:492] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:45.233379 5828 tablet_bootstrap.cc:654] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.236020 5827 tablet_bootstrap.cc:654] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.247731 5618 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:45.254326 6176 consensus_queue.cc:1035] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:45.256318 5919 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:45.256704 5919 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:45.257041 5919 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.262276 5938 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.262830 5938 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.265295 5938 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.266554 5827 tablet_bootstrap.cc:492] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:45.266674 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.267059 5827 ts_tablet_manager.cc:1397] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.004s
W20260807 13:32:45.267946 5620 leader_election.cc:341] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.269510 5919 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.272859 5919 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.274288 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:45.279313 5620 leader_election.cc:341] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.287295 5837 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.287815 5837 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.290287 5827 raft_consensus.cc:348] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.291203 5827 raft_consensus.cc:374] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.291513 5827 raft_consensus.cc:729] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.292347 5827 consensus_queue.cc:260] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.292954 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:45.290048 5837 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.304380 5827 ts_tablet_manager.cc:1428] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.037s user 0.009s sys 0.002s
I20260807 13:32:45.305576 6172 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.306028 6172 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.310045 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:45.310343 5827 tablet_bootstrap.cc:492] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:45.310714 5667 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:45.307986 6172 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:32:45.298913 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 46694.6us
I20260807 13:32:45.314486 5721 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:45.317906 6176 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:45.318516 6176 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:45.319031 6176 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.323108 6172 consensus_queue.cc:1035] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:45.336408 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:45.337244 5556 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:45.342768 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:45.343947 5555 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.352365 5555 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:45.353672 5827 tablet_bootstrap.cc:654] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.359965 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.360600 5828 tablet_bootstrap.cc:492] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:45.361027 5828 ts_tablet_manager.cc:1397] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.140s user 0.033s sys 0.073s
I20260807 13:32:45.358515 5618 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:45.363669 5501 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:45.364602 5556 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.364722 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:45.363171 5938 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:32:45.370724 5722 leader_election.cc:341] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.370482 5938 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.372447 5938 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.373895 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.374059 5553 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
W20260807 13:32:45.375177 5620 leader_election.cc:341] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.377084 6094 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.377496 5722 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:45.377522 6094 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.379093 5828 raft_consensus.cc:348] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.379714 6094 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:45.379895 5828 raft_consensus.cc:374] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.380189 5828 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.380223 6094 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:45.382683 5919 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:45.380825 5828 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.387182 5830 tablet_bootstrap.cc:492] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:45.386174 5919 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:45.390170 5919 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.389492 6094 raft_consensus.cc:686] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:45.392987 6094 consensus_queue.cc:237] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.395751 6176 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.396826 6088 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.397127 5837 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:45.397258 6088 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.400413 5830 ts_tablet_manager.cc:1397] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.242s user 0.049s sys 0.065s
I20260807 13:32:45.401630 5618 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:45.407512 6002 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:45.413304 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:45.414531 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:45.403043 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:45.415283 5830 raft_consensus.cc:348] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.410231 6088 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.416007 5830 raft_consensus.cc:374] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.419166 5830 raft_consensus.cc:729] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.419782 5830 consensus_queue.cc:260] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.420387 5828 ts_tablet_manager.cc:1428] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.059s user 0.004s sys 0.004s
I20260807 13:32:45.407689 6176 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:45.430972 6088 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.432166 6088 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.422938 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:45.425650 5554 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:45.442658 5827 tablet_bootstrap.cc:492] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:45.443048 5827 ts_tablet_manager.cc:1397] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.137s user 0.017s sys 0.033s
I20260807 13:32:45.447434 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:45.447985 5667 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.450294 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.455276 5667 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:45.460455 6088 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.460670 5556 raft_consensus.cc:2396] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260807 13:32:45.462169 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:45.462661 5618 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
W20260807 13:32:45.462949 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:45.463737 6235 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:45.464092 6235 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:45.464294 5828 tablet_bootstrap.cc:492] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:45.464403 6235 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.466506 5501 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:45.443002 6176 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.468451 6176 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.470114 6160 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.470762 6176 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:45.470706 6160 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.472198 6043 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:45.477196 5721 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:45.478780 5957 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:45.478833 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.479255 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:45.479437 5957 raft_consensus.cc:686] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:45.479880 5665 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:45.483101 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.480588 5957 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.483662 5721 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:45.487295 5919 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.482018 6160 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.445097 6002 raft_consensus.cc:686] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:45.491189 5919 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.491359 5830 ts_tablet_manager.cc:1428] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.091s user 0.004s sys 0.015s
I20260807 13:32:45.491044 5501 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:45.494805 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:45.495568 5556 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.495965 6043 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:45.495772 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:45.497421 5620 leader_election.cc:341] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.494755 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:45.509800 5828 tablet_bootstrap.cc:654] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.495532 6094 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:45.512974 5830 tablet_bootstrap.cc:492] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159: Bootstrap starting.
W20260807 13:32:45.498149 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 79394.2us
I20260807 13:32:45.516112 5554 raft_consensus.cc:2379] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:45.522207 5618 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:45.523584 5919 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.494570 6002 consensus_queue.cc:237] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.513336 6094 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:45.527760 6094 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.530166 5957 consensus_queue.cc:1035] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:32:45.537416 5919 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:45.539886 5827 raft_consensus.cc:348] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.540395 5827 raft_consensus.cc:374] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.540630 5827 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.541095 5827 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.544505 5556 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:45.547714 5827 ts_tablet_manager.cc:1428] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.104s user 0.000s sys 0.004s
I20260807 13:32:45.548138 5618 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:45.548758 5722 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:45.549500 6233 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.549728 5938 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:45.550268 5938 raft_consensus.cc:686] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:45.551048 5938 consensus_queue.cc:237] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.551614 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:45.549901 6244 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:32:45.553107 5552 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.553604 5770 raft_consensus.cc:1261] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:45.556080 5830 tablet_bootstrap.cc:654] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.548735 5827 tablet_bootstrap.cc:492] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:45.559008 5769 raft_consensus.cc:3037] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:45.561038 5722 leader_election.cc:341] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.558205 5919 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.011s
I20260807 13:32:45.588656 5553 raft_consensus.cc:1261] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:32:45.549747 6235 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.579571 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:45.549969 6233 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.595664 6160 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:32:45.609163 5556 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.619915 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:45.620859 6235 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.628916 5553 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.635432 6233 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.639190 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:45.643181 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:45.644369 5618 leader_election.cc:341] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.644052 5389 catalog_manager.cc:5495] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:45.649358 5553 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:45.650326 5618 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:45.650979 5938 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:45.651561 5938 raft_consensus.cc:686] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:45.652694 5828 tablet_bootstrap.cc:492] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:45.645599 5389 catalog_manager.cc:5495] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:32:45.652736 5620 leader_election.cc:341] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.655912 5828 ts_tablet_manager.cc:1397] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.210s user 0.015s sys 0.034s
I20260807 13:32:45.661834 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:45.666095 5620 leader_election.cc:341] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.666483 5620 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:45.668687 6255 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:45.670493 5827 tablet_bootstrap.cc:654] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.657089 5556 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:45.657582 6088 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260807 13:32:45.679935 5553 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.681111 6043 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:45.684679 5828 raft_consensus.cc:348] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.685370 5828 raft_consensus.cc:374] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.685626 5828 raft_consensus.cc:729] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.671144 6094 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.687778 6094 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:45.689687 5828 consensus_queue.cc:260] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.689254 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:45.692344 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:32:45.692538 5722 leader_election.cc:341] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.693084 5665 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.652343 5938 consensus_queue.cc:237] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.720584 5828 ts_tablet_manager.cc:1428] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.064s user 0.007s sys 0.000s
I20260807 13:32:45.721737 5828 tablet_bootstrap.cc:492] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:45.752828 5665 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:45.754698 5721 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:45.755918 6094 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:45.763042 6094 raft_consensus.cc:686] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:45.763850 6094 consensus_queue.cc:237] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.792712 5830 tablet_bootstrap.cc:492] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:45.793177 5830 ts_tablet_manager.cc:1397] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.282s user 0.013s sys 0.024s
I20260807 13:32:45.805647 5957 consensus_queue.cc:1035] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:45.808039 5830 raft_consensus.cc:348] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.808722 5830 raft_consensus.cc:374] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.808970 5830 raft_consensus.cc:729] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.810410 5828 tablet_bootstrap.cc:654] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.830483 5827 tablet_bootstrap.cc:492] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:45.850675 5827 ts_tablet_manager.cc:1397] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.302s user 0.013s sys 0.023s
I20260807 13:32:45.811846 5830 consensus_queue.cc:260] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.852762 5830 ts_tablet_manager.cc:1428] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.059s user 0.003s sys 0.007s
I20260807 13:32:45.853241 5827 raft_consensus.cc:348] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.853791 5830 tablet_bootstrap.cc:492] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:45.854020 5827 raft_consensus.cc:374] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.854368 5827 raft_consensus.cc:729] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.857357 5827 consensus_queue.cc:260] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.859867 5827 ts_tablet_manager.cc:1428] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260807 13:32:45.860365 5830 tablet_bootstrap.cc:654] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.860911 5827 tablet_bootstrap.cc:492] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:45.882735 5827 tablet_bootstrap.cc:654] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.884089 6244 consensus_queue.cc:1035] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:45.887326 5828 tablet_bootstrap.cc:492] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:45.887826 5828 ts_tablet_manager.cc:1397] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.166s user 0.016s sys 0.019s
I20260807 13:32:45.901517 5830 tablet_bootstrap.cc:492] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:45.902057 5830 ts_tablet_manager.cc:1397] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.048s user 0.008s sys 0.016s
I20260807 13:32:45.909026 5830 raft_consensus.cc:348] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.909942 5830 raft_consensus.cc:374] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.909636 5828 raft_consensus.cc:348] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.910537 5828 raft_consensus.cc:374] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.910864 5828 raft_consensus.cc:729] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.911558 5828 consensus_queue.cc:260] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.913652 5828 ts_tablet_manager.cc:1428] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.026s user 0.005s sys 0.002s
I20260807 13:32:45.914721 5828 tablet_bootstrap.cc:492] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:45.910247 5830 raft_consensus.cc:729] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.919338 5830 consensus_queue.cc:260] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.921504 5830 ts_tablet_manager.cc:1428] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260807 13:32:45.922329 5827 tablet_bootstrap.cc:492] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:45.920225 5391 catalog_manager.cc:5495] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:45.922762 5827 ts_tablet_manager.cc:1397] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.062s user 0.009s sys 0.008s
I20260807 13:32:45.925112 5827 raft_consensus.cc:348] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.925763 5827 raft_consensus.cc:374] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.926003 5827 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.928659 5830 tablet_bootstrap.cc:492] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:45.928277 5827 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.930662 5827 ts_tablet_manager.cc:1428] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 13:32:45.931574 5827 tablet_bootstrap.cc:492] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:45.935993 5830 tablet_bootstrap.cc:654] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.938158 5827 tablet_bootstrap.cc:654] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.937491 5828 tablet_bootstrap.cc:654] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.948467 5827 tablet_bootstrap.cc:492] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:45.948900 5827 ts_tablet_manager.cc:1397] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.003s
I20260807 13:32:45.947418 5828 tablet_bootstrap.cc:492] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:45.951264 5828 ts_tablet_manager.cc:1397] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.006s
I20260807 13:32:45.951174 5827 raft_consensus.cc:348] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.951841 5827 raft_consensus.cc:374] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.952102 5827 raft_consensus.cc:729] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.952647 5827 consensus_queue.cc:260] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.954042 5828 raft_consensus.cc:348] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.954762 5827 ts_tablet_manager.cc:1428] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260807 13:32:45.954772 5828 raft_consensus.cc:374] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.955309 5828 raft_consensus.cc:729] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.955731 5827 tablet_bootstrap.cc:492] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:45.956081 5828 consensus_queue.cc:260] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.961541 5827 tablet_bootstrap.cc:654] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.961606 5837 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.962069 5837 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.961452 5389 catalog_manager.cc:5495] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:45.963402 6088 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.963755 5837 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.963812 6088 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.965731 6088 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:45.966133 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.966282 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:45.967129 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:45.966982 5938 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:32:45.968535 5501 leader_election.cc:341] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.968261 5938 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.967739 5661 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:45.969523 5830 tablet_bootstrap.cc:492] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
W20260807 13:32:45.969533 5499 leader_election.cc:341] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.971149 5830 ts_tablet_manager.cc:1397] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.004s
I20260807 13:32:45.970993 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.972020 5771 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:45.973002 5827 tablet_bootstrap.cc:492] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:45.973469 5827 ts_tablet_manager.cc:1397] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20260807 13:32:45.973963 6235 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:45.974437 6235 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.974773 5830 raft_consensus.cc:348] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.975420 5830 raft_consensus.cc:374] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.975705 5830 raft_consensus.cc:729] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.975921 5827 raft_consensus.cc:348] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.976648 5827 raft_consensus.cc:374] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:45.977177 5827 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:45.970530 5828 ts_tablet_manager.cc:1428] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.019s user 0.005s sys 0.001s
I20260807 13:32:45.978406 5828 tablet_bootstrap.cc:492] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:45.973393 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:45.979722 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.980029 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:45.976673 5830 consensus_queue.cc:260] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.981563 5501 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:45.981750 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:45.982519 5618 leader_election.cc:341] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.971046 5499 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:45.984088 5837 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:45.984387 5837 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:45.984596 5828 tablet_bootstrap.cc:654] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:45.984681 5837 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:45.977898 5827 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.987980 5830 ts_tablet_manager.cc:1428] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20260807 13:32:45.988543 6041 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:32:45.990553 5620 consensus_peers.cc:487] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:45.990083 5827 ts_tablet_manager.cc:1428] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
W20260807 13:32:45.991519 5620 leader_election.cc:341] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.992229 5830 tablet_bootstrap.cc:492] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159: Bootstrap starting.
W20260807 13:32:45.994199 5618 leader_election.cc:341] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:45.992842 5827 tablet_bootstrap.cc:492] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:45.994738 5618 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:45.995723 6255 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:46.000888 5827 tablet_bootstrap.cc:654] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.009955 5830 tablet_bootstrap.cc:654] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.011059 6244 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:46.012841 5827 tablet_bootstrap.cc:492] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
W20260807 13:32:45.992388 5620 leader_election.cc:341] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.013267 5827 ts_tablet_manager.cc:1397] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.005s
I20260807 13:32:46.013528 5620 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:46.014467 6255 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:45.973412 5938 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.020174 5830 tablet_bootstrap.cc:492] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:46.020629 5830 ts_tablet_manager.cc:1397] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.003s
I20260807 13:32:46.022702 5837 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.023156 5830 raft_consensus.cc:348] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:45.976820 6235 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.024856 6244 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.032864 6043 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.032938 5830 raft_consensus.cc:374] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.033324 5830 raft_consensus.cc:729] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.033320 6043 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.034801 5830 consensus_queue.cc:260] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.035259 6043 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.036983 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:46.037554 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:46.038316 5770 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.038566 5830 ts_tablet_manager.cc:1428] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20260807 13:32:46.039499 5830 tablet_bootstrap.cc:492] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:46.028458 5827 raft_consensus.cc:348] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.036872 5837 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.040182 5827 raft_consensus.cc:374] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.040558 5827 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.041292 5827 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.045907 5830 tablet_bootstrap.cc:654] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.033226 6244 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.052111 6244 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:46.052505 5828 tablet_bootstrap.cc:492] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:46.052935 5828 ts_tablet_manager.cc:1397] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.075s user 0.007s sys 0.050s
I20260807 13:32:46.053054 5827 ts_tablet_manager.cc:1428] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.040s user 0.006s sys 0.002s
I20260807 13:32:46.053710 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:46.054541 5555 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 1: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:32:46.055413 5828 raft_consensus.cc:348] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.056104 5828 raft_consensus.cc:374] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.056376 5828 raft_consensus.cc:729] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.056474 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.057065 5828 consensus_queue.cc:260] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.054045 5827 tablet_bootstrap.cc:492] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:46.058226 5721 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:46.058912 6172 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.059077 5828 ts_tablet_manager.cc:1428] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260807 13:32:46.059981 5828 tablet_bootstrap.cc:492] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:46.061586 6094 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:46.062908 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:46.063488 5667 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.067350 6172 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:46.069342 5667 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:46.069795 6235 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:46.072023 5499 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:46.072865 5837 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:46.073238 5837 raft_consensus.cc:686] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:46.073926 5837 consensus_queue.cc:237] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.074785 5828 tablet_bootstrap.cc:654] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:46.087137 5620 consensus_peers.cc:487] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:46.088090 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.088881 5661 raft_consensus.cc:2379] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:46.090974 5390 catalog_manager.cc:5495] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:46.092810 5390 catalog_manager.cc:5495] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:46.097836 5938 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:46.114559 5499 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:46.115710 5837 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:46.133764 6302 log.cc:924] Time spent T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260807 13:32:46.136758 5827 tablet_bootstrap.cc:654] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.140214 6235 consensus_queue.cc:1035] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:46.147554 5828 tablet_bootstrap.cc:492] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:46.148063 5828 ts_tablet_manager.cc:1397] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.088s user 0.025s sys 0.003s
I20260807 13:32:46.150523 6235 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:46.134497 5770 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:46.129858 5837 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:46.154206 5828 raft_consensus.cc:348] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.154874 5828 raft_consensus.cc:374] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.155162 5828 raft_consensus.cc:729] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.155761 5828 consensus_queue.cc:260] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.157815 5828 ts_tablet_manager.cc:1428] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260807 13:32:46.157279 5391 catalog_manager.cc:5495] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:46.166183 6094 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.166949 6094 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.171559 6094 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:46.174564 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.175392 5665 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:46.177044 5721 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:46.178016 6176 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:46.178640 6176 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:46.178773 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:46.179102 6176 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:46.180078 5722 leader_election.cc:341] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.184844 5830 tablet_bootstrap.cc:492] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:46.185433 5830 ts_tablet_manager.cc:1397] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.146s user 0.018s sys 0.031s
I20260807 13:32:46.197009 6094 consensus_queue.cc:1035] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:46.200263 5830 raft_consensus.cc:348] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.201146 5830 raft_consensus.cc:374] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.201459 5830 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.204665 5830 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.208824 5828 tablet_bootstrap.cc:492] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:46.212459 5830 ts_tablet_manager.cc:1428] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.027s user 0.009s sys 0.001s
I20260807 13:32:46.230996 5830 tablet_bootstrap.cc:492] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:46.240302 5837 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.240891 5837 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.247370 6088 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.247798 6176 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.248091 6088 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.251924 6088 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.252840 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:46.253952 5769 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:46.255774 5501 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:46.260550 6088 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:46.260628 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:46.261087 6088 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:46.261252 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.261626 6088 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.262913 5837 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.262548 6176 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:46.267935 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.269174 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:46.269707 5660 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:46.269955 5667 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:46.273957 5722 leader_election.cc:341] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.278816 5499 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:46.280253 6043 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:46.264605 5665 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:46.280896 6043 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:46.290150 5827 tablet_bootstrap.cc:492] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:46.292022 5827 ts_tablet_manager.cc:1397] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.238s user 0.038s sys 0.059s
I20260807 13:32:46.288779 6043 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.293890 5830 tablet_bootstrap.cc:654] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.299748 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:46.302364 5501 leader_election.cc:341] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.311134 6233 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.311618 6233 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.337828 5827 raft_consensus.cc:348] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.340353 5827 raft_consensus.cc:374] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.340711 5827 raft_consensus.cc:729] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.341463 5827 consensus_queue.cc:260] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.343061 5828 tablet_bootstrap.cc:654] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.352425 5957 consensus_queue.cc:1035] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:46.354314 5827 ts_tablet_manager.cc:1428] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.062s user 0.007s sys 0.001s
I20260807 13:32:46.355777 5667 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:46.361872 6233 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.362639 6233 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.357460 6088 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.363130 6233 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.368624 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:46.343832 6043 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.371196 5827 tablet_bootstrap.cc:492] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
W20260807 13:32:46.371043 5620 leader_election.cc:341] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.373327 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:46.376892 5618 leader_election.cc:341] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.377260 5618 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:46.378430 6255 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:46.380103 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:46.381170 5660 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.381592 6176 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.382279 6176 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.385710 6176 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:46.380882 6088 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.390261 5721 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:46.395938 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:46.395809 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.396261 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:46.397804 5620 leader_election.cc:341] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.398519 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:46.402462 5721 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:46.399097 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:46.392957 6233 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.399257 5769 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.408311 6043 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.399257 6176 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:46.404909 6094 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:32:46.412164 5618 leader_election.cc:341] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.412722 5618 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:46.413504 6176 raft_consensus.cc:686] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:46.407385 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:46.414278 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:46.419915 6176 consensus_queue.cc:237] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:46.424211 5501 leader_election.cc:341] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.428231 5830 tablet_bootstrap.cc:492] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:46.428596 5830 ts_tablet_manager.cc:1397] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.207s user 0.016s sys 0.025s
I20260807 13:32:46.423547 5667 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.432411 5769 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:46.420734 6233 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:46.441355 5827 tablet_bootstrap.cc:654] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.449262 5660 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:46.451014 5499 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:46.453531 5501 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:46.455062 6297 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:46.455794 6297 raft_consensus.cc:686] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:46.457645 6043 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:46.459656 6043 raft_consensus.cc:686] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:46.461061 6043 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.464874 5830 raft_consensus.cc:348] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.466991 5830 raft_consensus.cc:374] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.467314 5830 raft_consensus.cc:729] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.457155 6297 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.468099 5830 consensus_queue.cc:260] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.478191 5830 ts_tablet_manager.cc:1428] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.049s user 0.007s sys 0.002s
I20260807 13:32:46.481328 5391 catalog_manager.cc:5495] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:46.485286 5667 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:46.488592 5830 tablet_bootstrap.cc:492] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:46.493031 5828 tablet_bootstrap.cc:492] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:46.493548 5828 ts_tablet_manager.cc:1397] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.301s user 0.029s sys 0.022s
I20260807 13:32:46.497180 5828 raft_consensus.cc:348] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.497825 5828 raft_consensus.cc:374] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.498087 5828 raft_consensus.cc:729] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.499178 6041 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:46.504837 5828 consensus_queue.cc:260] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.508091 5827 tablet_bootstrap.cc:492] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:46.508503 5827 ts_tablet_manager.cc:1397] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.138s user 0.004s sys 0.011s
I20260807 13:32:46.510483 5828 ts_tablet_manager.cc:1428] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260807 13:32:46.511518 5828 tablet_bootstrap.cc:492] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:46.528690 5827 raft_consensus.cc:348] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.529624 5827 raft_consensus.cc:374] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.529963 5827 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.530745 5827 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.538703 5827 ts_tablet_manager.cc:1428] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.030s user 0.007s sys 0.001s
I20260807 13:32:46.539619 5827 tablet_bootstrap.cc:492] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:46.532366 6297 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260807 13:32:46.549259 5828 tablet_bootstrap.cc:654] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.551942 5394 catalog_manager.cc:5495] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:46.557883 6233 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.560460 6233 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.562018 6255 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.562525 6255 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.563166 6233 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.564189 5830 tablet_bootstrap.cc:654] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.564435 6255 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.570849 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:46.572032 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:46.575222 5620 leader_election.cc:341] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:46.575953 5620 leader_election.cc:341] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.581662 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:46.588757 5827 tablet_bootstrap.cc:654] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:46.592607 5618 leader_election.cc:341] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.593120 5618 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:46.591156 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:46.594561 5545 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:46.595288 6255 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:46.591562 5394 catalog_manager.cc:5495] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:46.598429 5828 tablet_bootstrap.cc:492] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:46.598491 5770 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.598932 5828 ts_tablet_manager.cc:1397] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.021s
I20260807 13:32:46.601958 5828 raft_consensus.cc:348] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.602646 5828 raft_consensus.cc:374] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.602905 5828 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.603506 5828 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.606506 5618 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:46.608225 6233 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:46.608577 6233 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:46.608893 6233 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.609849 5828 ts_tablet_manager.cc:1428] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260807 13:32:46.615723 5828 tablet_bootstrap.cc:492] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:46.616009 6233 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.620019 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:46.616032 5830 tablet_bootstrap.cc:492] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:46.621155 5830 ts_tablet_manager.cc:1397] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.134s user 0.019s sys 0.009s
I20260807 13:32:46.623284 6233 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.624503 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:46.630414 5620 leader_election.cc:341] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.625952 5545 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.635552 5830 raft_consensus.cc:348] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.636550 5830 raft_consensus.cc:374] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.636933 5830 raft_consensus.cc:729] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.637882 5830 consensus_queue.cc:260] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.640667 5830 ts_tablet_manager.cc:1428] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.019s user 0.003s sys 0.003s
I20260807 13:32:46.641980 5830 tablet_bootstrap.cc:492] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159: Bootstrap starting.
W20260807 13:32:46.667378 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:46.671083 5957 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.671994 5957 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.678176 5827 tablet_bootstrap.cc:492] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:46.678623 5827 ts_tablet_manager.cc:1397] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.139s user 0.014s sys 0.023s
I20260807 13:32:46.683622 5827 raft_consensus.cc:348] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.684262 5827 raft_consensus.cc:374] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.684510 5827 raft_consensus.cc:729] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.684795 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.685050 5827 consensus_queue.cc:260] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.686702 5827 ts_tablet_manager.cc:1428] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20260807 13:32:46.687328 5830 tablet_bootstrap.cc:654] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.687160 5957 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:46.690754 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:46.694036 5722 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:46.695119 6094 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:46.697680 5545 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:46.698942 5827 tablet_bootstrap.cc:492] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:46.715684 5828 tablet_bootstrap.cc:654] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.716024 5957 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.723264 5827 tablet_bootstrap.cc:654] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.723560 6041 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.724140 5618 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:46.724238 6041 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.725405 6233 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:46.726212 6233 raft_consensus.cc:686] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:46.727782 6233 consensus_queue.cc:237] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.730419 6041 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.731137 5828 tablet_bootstrap.cc:492] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:46.716616 5957 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.731602 5828 ts_tablet_manager.cc:1397] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.121s user 0.008s sys 0.009s
I20260807 13:32:46.735605 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.735951 5828 raft_consensus.cc:348] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.736703 5828 raft_consensus.cc:374] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.736986 5828 raft_consensus.cc:729] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
W20260807 13:32:46.737600 5499 leader_election.cc:341] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.737660 5828 consensus_queue.cc:260] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.741285 5828 ts_tablet_manager.cc:1428] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 13:32:46.742506 5828 tablet_bootstrap.cc:492] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:46.745081 5827 tablet_bootstrap.cc:492] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:46.745535 5827 ts_tablet_manager.cc:1397] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.058s user 0.010s sys 0.006s
I20260807 13:32:46.747458 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:46.761957 5957 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:46.762913 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.763769 5667 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:46.765837 5827 raft_consensus.cc:348] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.766598 5827 raft_consensus.cc:374] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.766860 5827 raft_consensus.cc:729] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.766955 5721 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:32:46.767603 5827 consensus_queue.cc:260] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.769954 5827 ts_tablet_manager.cc:1428] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.024s user 0.004s sys 0.004s
I20260807 13:32:46.770371 6176 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:46.771003 5827 tablet_bootstrap.cc:492] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:46.770960 6176 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:46.771675 6176 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.788370 5828 tablet_bootstrap.cc:654] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.801385 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:46.802738 6176 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:46.805944 5501 leader_election.cc:341] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.806454 5501 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:46.808678 6041 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:46.810636 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:32:46.811630 5722 leader_election.cc:341] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.811728 5667 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.819582 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:46.821231 5827 tablet_bootstrap.cc:654] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.814600 6176 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:46.827446 5828 tablet_bootstrap.cc:492] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:46.829841 5828 ts_tablet_manager.cc:1397] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.088s user 0.010s sys 0.011s
W20260807 13:32:46.835470 5722 leader_election.cc:341] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.861979 5667 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:46.861323 5394 catalog_manager.cc:5495] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:46.862494 6041 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:46.866878 6041 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.868099 5828 raft_consensus.cc:348] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.868589 5828 raft_consensus.cc:374] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.868846 5828 raft_consensus.cc:729] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.868947 6041 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.866282 5721 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:46.869441 5828 consensus_queue.cc:260] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.870501 6176 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:46.870690 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:46.871071 6176 raft_consensus.cc:686] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:46.871511 5667 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:46.872546 5499 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:46.871914 6176 consensus_queue.cc:237] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.873409 6041 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:46.877625 5830 tablet_bootstrap.cc:492] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:46.881572 5830 ts_tablet_manager.cc:1397] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.240s user 0.017s sys 0.025s
I20260807 13:32:46.878872 5828 ts_tablet_manager.cc:1428] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.049s user 0.005s sys 0.000s
I20260807 13:32:46.882795 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:46.881328 6041 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:46.883858 6041 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.884830 5828 tablet_bootstrap.cc:492] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:46.890378 5828 tablet_bootstrap.cc:654] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:46.893344 5830 raft_consensus.cc:348] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.894037 5830 raft_consensus.cc:374] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.894332 5830 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.894968 5830 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.892863 6041 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.896965 5830 ts_tablet_manager.cc:1428] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.015s user 0.002s sys 0.002s
I20260807 13:32:46.898499 5830 tablet_bootstrap.cc:492] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:46.899554 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:46.900146 5667 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:46.905493 5830 tablet_bootstrap.cc:654] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:46.907083 5501 leader_election.cc:341] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.909269 6041 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:46.914865 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:46.917671 5770 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:46.920419 5501 leader_election.cc:341] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:46.913081 5667 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:46.926299 6244 consensus_queue.cc:1035] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:46.929317 5499 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:46.930668 5837 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:46.931249 5837 raft_consensus.cc:686] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:46.932219 5837 consensus_queue.cc:237] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.938093 5827 tablet_bootstrap.cc:492] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:46.940519 5827 ts_tablet_manager.cc:1397] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.170s user 0.015s sys 0.039s
I20260807 13:32:46.949234 5390 catalog_manager.cc:5495] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:46.963944 5827 raft_consensus.cc:348] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.964614 5827 raft_consensus.cc:374] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.964859 5827 raft_consensus.cc:729] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.965413 5827 consensus_queue.cc:260] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.967442 5827 ts_tablet_manager.cc:1428] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.027s user 0.005s sys 0.000s
I20260807 13:32:46.967905 5394 catalog_manager.cc:5495] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:46.970063 5828 tablet_bootstrap.cc:492] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:46.970381 5827 tablet_bootstrap.cc:492] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:46.970530 5828 ts_tablet_manager.cc:1397] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.086s user 0.019s sys 0.018s
I20260807 13:32:46.975775 5830 tablet_bootstrap.cc:492] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:46.976202 5830 ts_tablet_manager.cc:1397] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.078s user 0.004s sys 0.024s
I20260807 13:32:46.976493 5828 raft_consensus.cc:348] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.977205 5828 raft_consensus.cc:374] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:46.977471 5828 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:46.978557 5828 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:46.980715 5828 ts_tablet_manager.cc:1428] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.010s user 0.000s sys 0.006s
I20260807 13:32:46.995085 5828 tablet_bootstrap.cc:492] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:47.001178 5827 tablet_bootstrap.cc:654] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:47.001608 6041 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 13:32:47.009323 5828 tablet_bootstrap.cc:654] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:47.009747 6235 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.010257 6235 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.012514 6235 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.016775 5830 raft_consensus.cc:348] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.017450 5830 raft_consensus.cc:374] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:47.017709 5830 raft_consensus.cc:729] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:47.020653 5837 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:32:47.025768 5722 consensus_peers.cc:487] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 -> Peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Couldn't send request to peer 14f62bf285c448b9b7a21fabd7a5f0bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:47.025802 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:47.027298 5552 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:47.029742 5830 consensus_queue.cc:260] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.033699 5830 ts_tablet_manager.cc:1428] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.055s user 0.001s sys 0.005s
I20260807 13:32:47.040652 5618 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:47.045374 6364 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:47.045558 5827 tablet_bootstrap.cc:492] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:47.045774 6364 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:47.046003 5827 ts_tablet_manager.cc:1397] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.077s user 0.005s sys 0.012s
I20260807 13:32:47.046128 6364 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.048485 5827 raft_consensus.cc:348] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.049180 5827 raft_consensus.cc:374] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:47.049301 5830 tablet_bootstrap.cc:492] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:47.049464 5827 raft_consensus.cc:729] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:47.055290 6364 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.053380 5827 consensus_queue.cc:260] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.057519 6041 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.058707 5830 tablet_bootstrap.cc:654] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:47.062940 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:47.081858 5827 ts_tablet_manager.cc:1428] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.036s user 0.006s sys 0.000s
I20260807 13:32:47.188019 6233 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.147548 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:47.188865 6233 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.189867 5555 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.193715 5827 tablet_bootstrap.cc:492] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:47.139711 6364 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.140914 6043 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.058s
I20260807 13:32:47.085937 6041 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.208271 5828 tablet_bootstrap.cc:492] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:47.208673 5828 ts_tablet_manager.cc:1397] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.214s user 0.018s sys 0.017s
I20260807 13:32:47.211274 5830 tablet_bootstrap.cc:492] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:47.211695 5830 ts_tablet_manager.cc:1397] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.163s user 0.007s sys 0.009s
I20260807 13:32:47.219401 5957 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.219884 5957 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.222209 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:47.222599 5957 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:47.225487 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:47.225821 6233 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:32:47.228814 5721 leader_election.cc:341] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:47.231228 5620 leader_election.cc:341] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.236191 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:47.237169 5830 raft_consensus.cc:348] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.238067 5830 raft_consensus.cc:374] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:32:47.238037 5620 leader_election.cc:341] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.238682 5830 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
W20260807 13:32:47.239264 5620 leader_election.cc:341] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.240820 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:47.239857 5830 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.248733 5771 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.250344 6041 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.251554 5555 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:47.253368 5830 ts_tablet_manager.cc:1428] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.041s user 0.006s sys 0.004s
I20260807 13:32:47.252717 6376 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.255219 5830 tablet_bootstrap.cc:492] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:47.254686 6376 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.260169 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:47.261253 5660 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:47.262866 5499 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:47.265882 6373 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:47.266377 6373 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:32:47.266776 5618 leader_election.cc:341] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.267244 5618 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:47.267974 6235 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:47.266692 6041 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:47.266753 6373 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.269972 5828 raft_consensus.cc:348] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.270680 5828 raft_consensus.cc:374] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:47.271421 5827 tablet_bootstrap.cc:654] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:47.271911 6233 consensus_queue.cc:1035] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:47.274793 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:47.278589 6297 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.279251 6297 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.282544 5618 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:47.282804 6297 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.283766 6233 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:47.284512 6233 raft_consensus.cc:686] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:47.273082 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:47.286033 6233 consensus_queue.cc:237] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.296391 5957 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.296868 5830 tablet_bootstrap.cc:654] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:47.296983 5957 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.301409 6376 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.303577 5957 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:47.296222 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:47.305873 5666 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:47.307519 6373 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.312036 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:47.315407 5499 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:47.316512 6376 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:47.316946 6376 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:47.317363 6376 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.316963 6373 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.323951 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:47.324877 5660 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.329471 6376 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.331874 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:47.332998 5666 raft_consensus.cc:2379] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:47.335079 6376 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.336282 5830 tablet_bootstrap.cc:492] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:47.336784 5830 ts_tablet_manager.cc:1397] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.082s user 0.015s sys 0.007s
I20260807 13:32:47.337647 5827 tablet_bootstrap.cc:492] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:47.338054 5827 ts_tablet_manager.cc:1397] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.147s user 0.016s sys 0.044s
W20260807 13:32:47.339095 5722 leader_election.cc:341] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.339563 5722 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:47.339936 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:47.340763 5957 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:47.343326 5830 raft_consensus.cc:348] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.343997 5830 raft_consensus.cc:374] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:47.344297 5830 raft_consensus.cc:729] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:47.343647 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:47.345016 5830 consensus_queue.cc:260] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.270951 5828 raft_consensus.cc:729] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:47.354565 6235 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.355224 5830 ts_tablet_manager.cc:1428] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.018s user 0.001s sys 0.005s
I20260807 13:32:47.372013 5828 consensus_queue.cc:260] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.372224 6235 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.373260 5830 tablet_bootstrap.cc:492] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:47.374323 6235 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.374508 5828 ts_tablet_manager.cc:1428] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.166s user 0.009s sys 0.000s
I20260807 13:32:47.375552 5828 tablet_bootstrap.cc:492] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:47.357857 5660 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:47.379339 5499 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:47.379832 5830 tablet_bootstrap.cc:654] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:47.380293 6373 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:47.380815 6373 raft_consensus.cc:686] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:47.357039 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:47.347102 5827 raft_consensus.cc:348] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.365993 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:47.381690 6373 consensus_queue.cc:237] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.382422 5827 raft_consensus.cc:374] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:47.382699 5827 raft_consensus.cc:729] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:47.382850 5545 raft_consensus.cc:2379] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 1: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:32:47.383313 5827 consensus_queue.cc:260] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:47.367506 5501 leader_election.cc:341] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.385505 5827 ts_tablet_manager.cc:1428] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.047s user 0.007s sys 0.000s
I20260807 13:32:47.386613 5827 tablet_bootstrap.cc:492] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
W20260807 13:32:47.387614 5501 leader_election.cc:341] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.390787 5501 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:47.360718 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:47.392287 5666 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.393006 6376 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.395260 5830 tablet_bootstrap.cc:492] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:47.395690 5830 ts_tablet_manager.cc:1397] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.023s user 0.015s sys 0.000s
W20260807 13:32:47.402642 5501 leader_election.cc:341] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.409215 5722 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:47.411348 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:47.413511 5957 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.417572 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:47.425427 5618 leader_election.cc:341] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.420563 5830 raft_consensus.cc:348] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.424201 5837 consensus_queue.cc:1035] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:47.426628 5830 raft_consensus.cc:374] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:47.428320 5830 raft_consensus.cc:729] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:47.428011 5766 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:47.475440 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:47.477809 6376 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:47.482930 5666 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:47.535919 5830 consensus_queue.cc:260] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.656126 5766 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:47.698323 6176 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.699168 5830 ts_tablet_manager.cc:1428] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.303s user 0.018s sys 0.018s
I20260807 13:32:47.699008 6176 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.700340 5830 tablet_bootstrap.cc:492] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:47.611020 5957 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:47.704371 5828 tablet_bootstrap.cc:654] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:47.537456 5827 tablet_bootstrap.cc:654] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:47.601843 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 138748us
W20260807 13:32:47.732317 5620 consensus_peers.cc:487] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260807 13:32:47.735412 5620 leader_election.cc:341] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.737794 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:47.740757 6364 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:47.757102 5830 tablet_bootstrap.cc:654] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:47.768059 5827 tablet_bootstrap.cc:492] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:47.768677 5827 ts_tablet_manager.cc:1397] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.382s user 0.007s sys 0.014s
I20260807 13:32:47.768602 5391 catalog_manager.cc:5495] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:47.773506 6094 consensus_queue.cc:1035] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 13:32:47.775215 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260807 13:32:47.783224 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 318287us
I20260807 13:32:47.792318 6297 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.793151 6297 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.795595 6176 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:47.797159 6297 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.811724 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:47.811563 5827 raft_consensus.cc:348] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.815445 5827 raft_consensus.cc:374] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:47.815857 5828 tablet_bootstrap.cc:492] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:47.816309 5828 ts_tablet_manager.cc:1397] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.441s user 0.014s sys 0.029s
I20260807 13:32:47.815764 5827 raft_consensus.cc:729] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:47.821206 5828 raft_consensus.cc:348] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.823321 5828 raft_consensus.cc:374] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:47.823617 5828 raft_consensus.cc:729] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:47.823223 5827 consensus_queue.cc:260] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.824234 5828 consensus_queue.cc:260] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.827723 5828 ts_tablet_manager.cc:1428] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.011s user 0.002s sys 0.006s
I20260807 13:32:47.828548 5827 ts_tablet_manager.cc:1428] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.059s user 0.008s sys 0.004s
I20260807 13:32:47.828971 5828 tablet_bootstrap.cc:492] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:47.830678 5827 tablet_bootstrap.cc:492] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:47.796883 6176 consensus_queue.cc:1035] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:47.825045 5499 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:47.833518 6406 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:47.834127 5837 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:47.836359 5837 raft_consensus.cc:686] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:47.837056 5837 consensus_queue.cc:237] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.834236 6233 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 13:32:47.843515 6406 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:47.877439 6406 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:47.884277 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:47.898138 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:47.907495 5620 leader_election.cc:341] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.920771 5828 tablet_bootstrap.cc:654] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:47.932448 5499 leader_election.cc:341] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:47.998044 6406 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:48.001827 6406 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.007642 6406 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:48.010931 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:48.010977 6411 log.cc:924] Time spent T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.071s user 0.001s sys 0.000s
I20260807 13:32:48.017711 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:48.018050 6043 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 13:32:48.018949 5620 leader_election.cc:341] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.025588 5827 tablet_bootstrap.cc:654] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:48.071149 5830 tablet_bootstrap.cc:492] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:48.071934 5830 ts_tablet_manager.cc:1397] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.372s user 0.024s sys 0.048s
I20260807 13:32:48.083127 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:48.096622 5771 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:48.087533 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:48.103453 5544 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:48.111778 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:48.112841 5765 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:48.115023 5722 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:48.118270 6094 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:48.141888 5830 raft_consensus.cc:348] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.142593 5830 raft_consensus.cc:374] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:48.142855 5830 raft_consensus.cc:729] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:48.144690 5828 tablet_bootstrap.cc:492] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:48.145166 5828 ts_tablet_manager.cc:1397] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.317s user 0.018s sys 0.021s
W20260807 13:32:48.150998 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 54248.8us
I20260807 13:32:48.152586 5828 raft_consensus.cc:348] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.153393 5828 raft_consensus.cc:374] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:48.153720 5828 raft_consensus.cc:729] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:48.146996 5830 consensus_queue.cc:260] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.154963 5828 consensus_queue.cc:260] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.157028 5828 ts_tablet_manager.cc:1428] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.012s user 0.002s sys 0.006s
I20260807 13:32:48.160513 5501 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:48.164769 5827 tablet_bootstrap.cc:492] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:48.165263 5827 ts_tablet_manager.cc:1397] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.335s user 0.019s sys 0.032s
I20260807 13:32:48.166643 5828 tablet_bootstrap.cc:492] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:48.168335 5837 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:48.168654 5837 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:48.168962 5837 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:48.202081 5501 consensus_peers.cc:487] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:48.203843 6297 consensus_queue.cc:1035] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:48.204630 5830 ts_tablet_manager.cc:1428] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.132s user 0.008s sys 0.000s
I20260807 13:32:48.204329 5827 raft_consensus.cc:348] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.205224 5827 raft_consensus.cc:374] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:48.205565 5827 raft_consensus.cc:729] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:48.207082 5827 consensus_queue.cc:260] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.213485 5827 ts_tablet_manager.cc:1428] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.048s user 0.005s sys 0.003s
I20260807 13:32:48.222077 6391 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260807 13:32:48.226451 5837 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.231560 5837 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:32:48.235711 5618 leader_election.cc:341] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.236191 5618 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:48.236450 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:48.237942 6406 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:32:48.238005 5499 leader_election.cc:341] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.239229 5618 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:48.242733 6391 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:48.243088 6391 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:48.243408 6391 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:48.257097 6391 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.263621 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:48.265537 5620 leader_election.cc:341] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.270123 5830 tablet_bootstrap.cc:492] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: Bootstrap starting.
W20260807 13:32:48.270293 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 67481.3us
I20260807 13:32:48.275355 5827 tablet_bootstrap.cc:492] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:48.287312 5394 catalog_manager.cc:5495] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:48.293531 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:48.296696 5394 catalog_manager.cc:5495] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:48.299829 5767 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:48.316562 5830 tablet_bootstrap.cc:654] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:48.283468 6391 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:32:48.346524 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 61716.3us
I20260807 13:32:48.341154 6235 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:32:48.354290 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 54757.6us
I20260807 13:32:48.358630 6235 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.381843 6235 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:48.402428 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:48.403578 5542 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:48.419935 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:48.408130 6376 consensus_queue.cc:1035] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
W20260807 13:32:48.432047 5618 leader_election.cc:341] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.436992 5827 tablet_bootstrap.cc:654] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:48.524770 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 57843.6us
I20260807 13:32:48.533756 5837 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:48.534323 5837 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.468982 6394 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:48.563094 5837 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:48.564960 5837 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:48.565407 5837 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.545814 5767 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:48.532945 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:48.566172 6429 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:48.576968 5837 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:48.552186 6394 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.586400 5830 tablet_bootstrap.cc:492] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:48.586967 5830 ts_tablet_manager.cc:1397] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.317s user 0.015s sys 0.041s
W20260807 13:32:48.588972 5620 leader_election.cc:341] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.589390 5620 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:48.591420 5828 tablet_bootstrap.cc:654] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:48.586990 6394 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:48.596386 6429 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.599105 6429 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:48.610566 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:48.594667 6235 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:48.619175 5501 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:32:48.623229 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:48.632480 5827 tablet_bootstrap.cc:492] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:48.633060 5827 ts_tablet_manager.cc:1397] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.358s user 0.013s sys 0.013s
I20260807 13:32:48.634267 6434 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:48.636350 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:48.637583 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 107159us
W20260807 13:32:48.641122 5620 leader_election.cc:341] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.641232 5763 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:48.649381 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:48.640610 6434 raft_consensus.cc:686] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:48.650965 6434 consensus_queue.cc:237] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.625300 5542 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:48.684495 6429 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:48.685158 6429 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.690459 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:48.691661 5830 raft_consensus.cc:348] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.693372 5830 raft_consensus.cc:374] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:48.693727 5830 raft_consensus.cc:729] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:48.694578 5830 consensus_queue.cc:260] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.695389 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:48.697201 5830 ts_tablet_manager.cc:1428] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.110s user 0.008s sys 0.002s
I20260807 13:32:48.698431 5721 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:32:48.699257 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 54825.7us
W20260807 13:32:48.700275 5620 leader_election.cc:341] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:48.702250 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 57014.1us
I20260807 13:32:48.708112 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:48.710129 5618 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:48.712167 6391 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:48.712393 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:48.712697 6391 raft_consensus.cc:686] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:48.715308 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:32:48.718482 5618 leader_election.cc:341] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.691309 6429 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:48.720410 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:48.717417 6391 consensus_queue.cc:237] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.718897 5618 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:48.723649 6429 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:32:48.724951 5501 leader_election.cc:341] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:48.725703 5499 leader_election.cc:341] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:48.726128 5501 leader_election.cc:341] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.726187 5499 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:32:48.727600 5499 leader_election.cc:341] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.728032 5499 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:48.728650 6041 consensus_queue.cc:1035] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:48.741140 5830 tablet_bootstrap.cc:492] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:48.733752 6376 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:48.733870 6041 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:48.742450 5827 raft_consensus.cc:348] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.745028 5827 raft_consensus.cc:374] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:48.745316 5827 raft_consensus.cc:729] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:48.745972 5827 consensus_queue.cc:260] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:48.747052 5618 leader_election.cc:341] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:48.747459 5618 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:48.748517 6235 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:48.777448 5827 ts_tablet_manager.cc:1428] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.144s user 0.007s sys 0.003s
I20260807 13:32:48.777719 5828 tablet_bootstrap.cc:492] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:48.780149 5828 ts_tablet_manager.cc:1397] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.614s user 0.012s sys 0.032s
I20260807 13:32:48.797418 5828 raft_consensus.cc:348] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.798301 5828 raft_consensus.cc:374] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:48.797696 5390 catalog_manager.cc:5495] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:48.798593 5828 raft_consensus.cc:729] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:48.805270 5828 consensus_queue.cc:260] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.817349 5828 ts_tablet_manager.cc:1428] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.037s user 0.007s sys 0.000s
I20260807 13:32:48.817559 5827 tablet_bootstrap.cc:492] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:48.818491 5828 tablet_bootstrap.cc:492] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:48.846227 5769 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:48.889552 6391 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:48.890465 6391 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.933706 6235 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:48.934753 6235 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:48.936909 6391 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:48.938378 6235 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:48.942245 6176 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:48.967409 5830 tablet_bootstrap.cc:654] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:48.980249 5827 tablet_bootstrap.cc:654] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:48.981523 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:48.981389 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:48.983291 5770 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 1: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:32:48.984684 5828 tablet_bootstrap.cc:654] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:48.995594 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:48.996596 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:49.006299 5620 leader_election.cc:341] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.007579 5827 tablet_bootstrap.cc:492] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:49.009065 5827 ts_tablet_manager.cc:1397] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.217s user 0.009s sys 0.005s
I20260807 13:32:49.011536 5827 raft_consensus.cc:348] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.012192 5827 raft_consensus.cc:374] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.012466 5827 raft_consensus.cc:729] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.013042 5827 consensus_queue.cc:260] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.015723 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:49.016551 6235 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.023409 6235 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 13:32:49.024492 5618 leader_election.cc:341] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.027453 5830 tablet_bootstrap.cc:492] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:49.027926 5830 ts_tablet_manager.cc:1397] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.287s user 0.013s sys 0.012s
I20260807 13:32:49.028059 5827 ts_tablet_manager.cc:1428] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.019s user 0.005s sys 0.001s
I20260807 13:32:49.028966 5827 tablet_bootstrap.cc:492] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:49.030541 5830 raft_consensus.cc:348] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.031529 5830 raft_consensus.cc:374] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.031880 5830 raft_consensus.cc:729] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.032603 5830 consensus_queue.cc:260] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.024914 5618 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:49.034575 6235 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:49.035228 5830 ts_tablet_manager.cc:1428] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 13:32:49.036305 5830 tablet_bootstrap.cc:492] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159: Bootstrap starting.
W20260807 13:32:49.038796 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:49.038749 5394 catalog_manager.cc:5495] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:49.043044 5830 tablet_bootstrap.cc:654] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:49.046811 5827 tablet_bootstrap.cc:654] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:49.060142 5828 tablet_bootstrap.cc:492] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:49.060597 5828 ts_tablet_manager.cc:1397] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.242s user 0.013s sys 0.009s
I20260807 13:32:49.062701 6176 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.063302 6176 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.066553 6176 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:49.067699 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:49.068321 5830 tablet_bootstrap.cc:492] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:49.068920 5830 ts_tablet_manager.cc:1397] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.005s
I20260807 13:32:49.069340 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:49.069927 5665 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:49.071882 5721 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:32:49.072436 5722 leader_election.cc:341] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.072858 6176 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:49.072629 5830 raft_consensus.cc:348] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.073549 5830 raft_consensus.cc:374] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.073431 6176 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:49.074005 5830 raft_consensus.cc:729] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.074296 6176 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.074754 5830 consensus_queue.cc:260] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.076445 5828 raft_consensus.cc:348] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.077203 5828 raft_consensus.cc:374] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.077260 5830 ts_tablet_manager.cc:1428] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.008s user 0.002s sys 0.005s
I20260807 13:32:49.080116 5828 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.081039 5830 tablet_bootstrap.cc:492] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:49.084401 6376 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.085544 6376 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.088156 6376 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.089613 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:49.081067 5828 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.090629 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:49.091214 5770 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:49.091223 5665 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:49.093604 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:49.094594 6297 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:49.094972 6297 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:49.095412 5828 ts_tablet_manager.cc:1428] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.035s user 0.006s sys 0.001s
I20260807 13:32:49.095373 6297 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.096702 5828 tablet_bootstrap.cc:492] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:49.111063 5830 tablet_bootstrap.cc:654] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:49.112831 6434 consensus_queue.cc:1035] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:49.111618 6176 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.144243 5828 tablet_bootstrap.cc:654] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:49.151279 6176 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:49.153155 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:49.153326 6297 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.154212 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:49.154729 5665 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:49.159313 5722 leader_election.cc:341] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.161118 5827 tablet_bootstrap.cc:492] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:49.161595 5827 ts_tablet_manager.cc:1397] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.133s user 0.021s sys 0.002s
I20260807 13:32:49.170048 5665 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:49.173419 5721 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:49.173795 5827 raft_consensus.cc:348] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.174526 5827 raft_consensus.cc:374] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.176649 5827 raft_consensus.cc:729] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.177214 5827 consensus_queue.cc:260] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.175861 6176 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:49.178977 6176 raft_consensus.cc:686] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:49.180408 6176 consensus_queue.cc:237] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.184983 6297 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.186489 5828 tablet_bootstrap.cc:492] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:49.186944 5828 ts_tablet_manager.cc:1397] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.090s user 0.012s sys 0.007s
I20260807 13:32:49.189000 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:49.189571 5770 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.190325 6235 consensus_queue.cc:1035] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:49.212360 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:49.213129 5665 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.214308 6297 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.215855 6297 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.218549 6297 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.243788 5828 raft_consensus.cc:348] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.244554 5828 raft_consensus.cc:374] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.244824 5828 raft_consensus.cc:729] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.232656 5770 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:49.247001 5828 consensus_queue.cc:260] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.247471 5827 ts_tablet_manager.cc:1428] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.086s user 0.009s sys 0.001s
I20260807 13:32:49.248512 5827 tablet_bootstrap.cc:492] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:49.248559 5665 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:49.254472 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:49.255041 5666 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:49.260380 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:49.264752 5828 ts_tablet_manager.cc:1428] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.078s user 0.003s sys 0.005s
I20260807 13:32:49.267004 5499 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:32:49.283699 5620 consensus_peers.cc:487] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:49.286906 5828 tablet_bootstrap.cc:492] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:49.274964 6456 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:49.276640 6376 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:49.308918 6376 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:49.389101 6376 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:49.426158 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 157552us
I20260807 13:32:49.442929 5830 tablet_bootstrap.cc:492] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:49.443429 5830 ts_tablet_manager.cc:1397] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.363s user 0.010s sys 0.022s
I20260807 13:32:49.446190 5827 tablet_bootstrap.cc:654] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:49.449445 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:49.449378 6456 raft_consensus.cc:686] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:49.457425 6456 consensus_queue.cc:237] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.463327 6376 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.467892 5830 raft_consensus.cc:348] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.468815 5830 raft_consensus.cc:374] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.469144 5830 raft_consensus.cc:729] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.471843 5830 consensus_queue.cc:260] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.474442 5391 catalog_manager.cc:5495] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:32:49.472927 5501 leader_election.cc:341] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.507678 5830 ts_tablet_manager.cc:1428] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.064s user 0.007s sys 0.003s
I20260807 13:32:49.511941 6501 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.532769 5830 tablet_bootstrap.cc:492] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:49.511350 6491 consensus_queue.cc:1035] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260807 13:32:49.530088 6501 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.547490 6376 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.548761 6501 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.554984 6456 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.555598 6456 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.557988 6456 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.560267 6501 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.560817 6501 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:49.564594 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 49782.3us
I20260807 13:32:49.566861 5827 tablet_bootstrap.cc:492] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:49.567289 5827 ts_tablet_manager.cc:1397] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.319s user 0.006s sys 0.018s
I20260807 13:32:49.568998 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:49.575084 5828 tablet_bootstrap.cc:654] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:49.575834 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:49.592425 5501 leader_election.cc:341] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.600868 5827 raft_consensus.cc:348] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.601827 5827 raft_consensus.cc:374] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.602216 5827 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.602958 5827 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.599428 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:49.618713 5827 ts_tablet_manager.cc:1428] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.051s user 0.006s sys 0.001s
I20260807 13:32:49.620160 6501 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.620503 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:49.637823 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:49.638518 5543 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:49.653374 5830 tablet_bootstrap.cc:654] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:49.654052 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 44615.2us
W20260807 13:32:49.660156 5618 leader_election.cc:341] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.663781 6439 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.664215 6439 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.669628 6439 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:49.673218 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:49.673966 5763 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.689435 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:49.689462 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:49.690193 5660 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.690610 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:49.691104 5827 tablet_bootstrap.cc:492] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:49.678201 6515 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.703337 5722 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:49.698385 6515 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.711022 5618 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:49.715515 6518 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:49.720717 6518 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:49.717804 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:49.721105 6518 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.721639 5661 raft_consensus.cc:2379] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:49.722960 5660 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:49.731019 6515 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.732973 5556 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.748881 5828 tablet_bootstrap.cc:492] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:49.749342 5828 ts_tablet_manager.cc:1397] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.482s user 0.035s sys 0.011s
I20260807 13:32:49.759655 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:49.761027 5618 leader_election.cc:341] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.761626 5828 raft_consensus.cc:348] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.762298 5828 raft_consensus.cc:374] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.762535 5828 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.763088 5828 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.767518 5828 ts_tablet_manager.cc:1428] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260807 13:32:49.768868 5828 tablet_bootstrap.cc:492] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:49.778616 6446 consensus_queue.cc:1035] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:49.788311 5827 tablet_bootstrap.cc:654] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:49.787997 5391 catalog_manager.cc:5495] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
W20260807 13:32:49.806092 5722 consensus_peers.cc:487] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 -> Peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Couldn't send request to peer 14f62bf285c448b9b7a21fabd7a5f0bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260807 13:32:49.807498 6439 consensus_queue.cc:1035] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:49.821655 6518 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.823655 6518 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.828195 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:49.828860 5554 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.829784 5830 tablet_bootstrap.cc:492] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:49.830236 5830 ts_tablet_manager.cc:1397] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.298s user 0.009s sys 0.024s
I20260807 13:32:49.846799 5830 raft_consensus.cc:348] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.847584 5830 raft_consensus.cc:374] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:49.850493 5830 raft_consensus.cc:729] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.851207 5830 consensus_queue.cc:260] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.852972 5830 ts_tablet_manager.cc:1428] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.022s user 0.004s sys 0.002s
I20260807 13:32:49.854115 5830 tablet_bootstrap.cc:492] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:49.854601 5554 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:49.855532 5618 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:49.860469 6391 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:49.861959 6391 raft_consensus.cc:686] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:49.868431 5828 tablet_bootstrap.cc:654] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:49.868048 6391 consensus_queue.cc:237] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.893769 5830 tablet_bootstrap.cc:654] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:49.905624 6446 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.906251 6446 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.938670 5827 tablet_bootstrap.cc:492] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:49.939216 5827 ts_tablet_manager.cc:1397] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.248s user 0.014s sys 0.001s
W20260807 13:32:49.940165 5620 leader_election.cc:341] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.940572 5620 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:32:49.941515 5620 leader_election.cc:341] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.942796 6519 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:49.946847 5827 raft_consensus.cc:348] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.947603 5499 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:49.948590 6434 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:49.949142 6446 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:49.949656 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:49.930204 6510 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:49.947726 5827 raft_consensus.cc:374] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 13:32:49.951015 5722 leader_election.cc:341] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.951211 5499 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:49.951174 5827 raft_consensus.cc:729] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:49.952711 6297 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:49.953167 5827 consensus_queue.cc:260] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.956465 6514 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:49.956348 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:49.956360 6297 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.958179 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:49.958847 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:49.963368 5662 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:49.968765 6514 raft_consensus.cc:686] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:49.969671 6514 consensus_queue.cc:237] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:49.970558 6297 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:49.973301 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:49.979465 5620 leader_election.cc:341] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
W20260807 13:32:49.980444 5501 leader_election.cc:341] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.981287 5394 catalog_manager.cc:5495] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:49.982571 5827 ts_tablet_manager.cc:1428] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.043s user 0.007s sys 0.000s
I20260807 13:32:49.984185 5827 tablet_bootstrap.cc:492] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:49.985770 5828 tablet_bootstrap.cc:492] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:49.986289 5828 ts_tablet_manager.cc:1397] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.218s user 0.015s sys 0.001s
I20260807 13:32:49.987871 5721 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:49.989203 6446 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:49.989562 6446 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:49.989885 6446 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:49.996165 5827 tablet_bootstrap.cc:654] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
W20260807 13:32:49.997575 5620 leader_election.cc:341] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:49.997974 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:49.998965 6518 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:50.000380 5828 raft_consensus.cc:348] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.000907 5828 raft_consensus.cc:374] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.001130 5828 raft_consensus.cc:729] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.001657 5828 consensus_queue.cc:260] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.009406 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:50.010142 5662 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:50.011950 5828 ts_tablet_manager.cc:1428] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260807 13:32:50.014976 5499 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:50.020288 6446 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.021672 6504 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:50.022025 6504 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:50.022356 6504 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.025158 6453 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:50.030539 5828 tablet_bootstrap.cc:492] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:50.027189 5394 catalog_manager.cc:5495] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:50.028250 6508 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260807 13:32:50.036079 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:50.036669 5662 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.037003 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:50.037361 5830 tablet_bootstrap.cc:492] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:50.037766 5830 ts_tablet_manager.cc:1397] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.184s user 0.014s sys 0.005s
I20260807 13:32:50.025643 6453 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.041249 6453 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.042464 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:50.047330 5830 raft_consensus.cc:348] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.048251 5830 raft_consensus.cc:374] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.048544 5830 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.051429 5830 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:50.052532 5722 leader_election.cc:341] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.030694 6446 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:50.053455 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:50.060734 5830 ts_tablet_manager.cc:1428] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.023s user 0.003s sys 0.003s
I20260807 13:32:50.060801 5501 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:50.067147 6508 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:50.068904 6518 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:50.070127 6518 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.073786 6518 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.076874 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:32:50.079627 5620 leader_election.cc:341] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.079994 5662 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:50.070441 6504 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.082639 5830 tablet_bootstrap.cc:492] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:50.086755 6453 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:50.088516 6504 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.089704 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:50.092561 5554 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:50.093096 5828 tablet_bootstrap.cc:654] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:50.097936 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:50.098806 5661 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.082582 5721 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:50.103796 6510 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:50.104425 6510 raft_consensus.cc:686] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:50.104598 5618 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:50.105973 6518 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:50.105816 6510 consensus_queue.cc:237] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.106664 6518 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:50.107283 6518 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.130381 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:50.132748 5830 tablet_bootstrap.cc:654] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:50.146220 5661 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
W20260807 13:32:50.161931 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:50.171566 5827 tablet_bootstrap.cc:492] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:50.172155 5827 ts_tablet_manager.cc:1397] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.189s user 0.016s sys 0.009s
W20260807 13:32:50.179411 5501 leader_election.cc:341] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.181526 5499 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:50.183295 6514 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:50.183923 6514 raft_consensus.cc:686] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:50.211153 6518 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.224979 5554 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.185271 6514 consensus_queue.cc:237] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.237298 5827 raft_consensus.cc:348] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.239816 5827 raft_consensus.cc:374] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.240139 5827 raft_consensus.cc:729] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.243418 5827 consensus_queue.cc:260] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.249132 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:32:50.259945 5620 leader_election.cc:341] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.265774 5827 ts_tablet_manager.cc:1428] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.093s user 0.002s sys 0.008s
I20260807 13:32:50.267004 5827 tablet_bootstrap.cc:492] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:50.250131 6518 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.293985 5828 tablet_bootstrap.cc:492] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:50.294499 5828 ts_tablet_manager.cc:1397] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.268s user 0.016s sys 0.014s
I20260807 13:32:50.313174 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:50.314188 5543 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.316653 5828 raft_consensus.cc:348] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.317663 5828 raft_consensus.cc:374] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.318051 5828 raft_consensus.cc:729] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.327208 5827 tablet_bootstrap.cc:654] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:50.328271 5828 consensus_queue.cc:260] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.340598 5828 ts_tablet_manager.cc:1428] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.046s user 0.006s sys 0.004s
I20260807 13:32:50.342186 6520 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:50.343241 5828 tablet_bootstrap.cc:492] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Bootstrap starting.
I20260807 13:32:50.342739 6520 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.345145 6520 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.345633 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:50.349552 5659 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:50.349581 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:50.351797 5499 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:50.353125 6551 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:50.353469 6551 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:50.353904 6551 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.353961 5391 catalog_manager.cc:5495] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:32:50.355031 5501 leader_election.cc:341] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.358167 5830 tablet_bootstrap.cc:492] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:50.358731 5830 ts_tablet_manager.cc:1397] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.276s user 0.010s sys 0.018s
I20260807 13:32:50.360200 5394 catalog_manager.cc:5495] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:50.374500 5828 tablet_bootstrap.cc:654] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:50.376003 5543 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:50.377480 5618 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:50.378427 6518 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:50.378902 6518 raft_consensus.cc:686] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:50.379500 6518 consensus_queue.cc:237] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.436328 5830 raft_consensus.cc:348] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.436889 5830 raft_consensus.cc:374] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.437122 5830 raft_consensus.cc:729] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.437572 5830 consensus_queue.cc:260] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.426482 6502 consensus_queue.cc:1035] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260807 13:32:50.445403 5830 ts_tablet_manager.cc:1428] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.086s user 0.009s sys 0.001s
I20260807 13:32:50.450290 5827 tablet_bootstrap.cc:492] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:50.450836 5827 ts_tablet_manager.cc:1397] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.184s user 0.017s sys 0.014s
I20260807 13:32:50.458696 5830 tablet_bootstrap.cc:492] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:50.460103 5828 tablet_bootstrap.cc:492] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: No bootstrap required, opened a new log
I20260807 13:32:50.459564 6551 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:50.462719 5501 consensus_peers.cc:487] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:50.472323 5828 ts_tablet_manager.cc:1397] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent bootstrapping tablet: real 0.129s user 0.015s sys 0.039s
I20260807 13:32:50.475293 5828 raft_consensus.cc:348] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.475965 5828 raft_consensus.cc:374] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.476239 5828 raft_consensus.cc:729] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.478332 5828 consensus_queue.cc:260] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.483717 5828 ts_tablet_manager.cc:1428] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260807 13:32:50.488044 6176 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:50.488502 6176 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.490337 6176 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:50.493166 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:50.494439 5722 leader_election.cc:341] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.497426 6551 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.471200 5830 tablet_bootstrap.cc:654] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:50.499092 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:50.499755 5659 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 0.
I20260807 13:32:50.501435 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:50.502022 5666 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.471598 5827 raft_consensus.cc:348] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.502708 5827 raft_consensus.cc:374] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.503068 5827 raft_consensus.cc:729] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.503877 5827 consensus_queue.cc:260] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.508896 5666 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:50.511027 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:50.513885 5827 ts_tablet_manager.cc:1428] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.063s user 0.007s sys 0.000s
I20260807 13:32:50.523772 5827 tablet_bootstrap.cc:492] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
W20260807 13:32:50.518705 5620 consensus_peers.cc:487] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:50.519412 5721 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:50.520661 5391 catalog_manager.cc:5495] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:50.528303 5499 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:50.528659 6176 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:50.528975 6176 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:50.529279 6176 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.530857 6551 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
W20260807 13:32:50.531131 5501 leader_election.cc:341] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.531463 6551 raft_consensus.cc:686] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:50.532372 6551 consensus_queue.cc:237] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.539642 5827 tablet_bootstrap.cc:654] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:50.551522 6176 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.553593 6176 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:50.555148 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:50.555855 5666 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.567112 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:32:50.570616 5722 leader_election.cc:341] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.577051 5394 catalog_manager.cc:5495] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:50.599911 5830 tablet_bootstrap.cc:492] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:50.602033 5830 ts_tablet_manager.cc:1397] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.156s user 0.022s sys 0.033s
I20260807 13:32:50.604627 6453 consensus_queue.cc:1035] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:50.626080 6518 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:50.626696 5830 raft_consensus.cc:348] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.662774 5830 raft_consensus.cc:374] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.663468 5830 raft_consensus.cc:729] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.664088 5830 consensus_queue.cc:260] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.669415 5666 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:32:50.635396 6376 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:50.670558 5721 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:50.636895 6516 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:50.671674 6498 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:50.671046 6376 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.672104 6516 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.674247 5830 ts_tablet_manager.cc:1428] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.072s user 0.012s sys 0.000s
I20260807 13:32:50.675391 5830 tablet_bootstrap.cc:492] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:50.672163 6498 raft_consensus.cc:686] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:32:50.681156 5827 tablet_bootstrap.cc:492] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:50.681730 5827 ts_tablet_manager.cc:1397] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.158s user 0.017s sys 0.007s
I20260807 13:32:50.686331 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:50.687001 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:32:50.688110 5620 leader_election.cc:341] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.687067 5827 raft_consensus.cc:348] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.689427 5827 raft_consensus.cc:374] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.689667 5827 raft_consensus.cc:729] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.648775 6510 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260807 13:32:50.691021 5827 consensus_queue.cc:260] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.690173 6516 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.662076 6518 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.696354 6439 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:50.698693 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:50.700444 5665 raft_consensus.cc:2379] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:50.700553 5545 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 0.
I20260807 13:32:50.702847 5543 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.686976 6498 consensus_queue.cc:237] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.703832 5618 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:50.705068 6516 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:50.705394 6516 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:50.705793 6516 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.708182 6439 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.710892 6439 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:50.712790 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:50.713937 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:50.714856 5548 raft_consensus.cc:2379] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 1: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:32:50.715907 5722 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:50.717613 6176 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.719391 5827 ts_tablet_manager.cc:1428] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.037s user 0.006s sys 0.000s
I20260807 13:32:50.720327 5827 tablet_bootstrap.cc:492] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
W20260807 13:32:50.728861 5501 consensus_peers.cc:487] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Couldn't send request to peer 737c581af06a42df94970a1542600159. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:50.741452 5830 tablet_bootstrap.cc:654] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:50.750245 6176 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:50.749500 6376 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.758199 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:50.771093 5501 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:50.774225 6514 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:50.775987 5827 tablet_bootstrap.cc:654] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:50.779892 6516 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.787962 6498 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:50.793265 5389 catalog_manager.cc:5495] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:32:50.804584 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:50.806685 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:32:50.807514 5545 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
W20260807 13:32:50.810679 5618 leader_election.cc:341] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.819904 6516 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.816711 6518 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:50.855786 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:50.859292 5830 tablet_bootstrap.cc:492] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:50.859946 5830 ts_tablet_manager.cc:1397] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.185s user 0.017s sys 0.025s
W20260807 13:32:50.865065 5620 leader_election.cc:341] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.865504 5620 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:32:50.867378 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:50.871143 6516 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:50.877626 5827 tablet_bootstrap.cc:492] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:50.879092 5545 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:32:50.879297 5827 ts_tablet_manager.cc:1397] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.159s user 0.014s sys 0.009s
W20260807 13:32:50.887792 5620 leader_election.cc:341] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:50.888609 6235 consensus_queue.cc:1035] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:50.895874 6499 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:50.901198 5827 raft_consensus.cc:348] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.909742 5827 raft_consensus.cc:374] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.910060 5827 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.910744 5827 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.913640 5827 ts_tablet_manager.cc:1428] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20260807 13:32:50.914664 5827 tablet_bootstrap.cc:492] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:50.901126 5618 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:50.919659 6235 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:50.920091 6235 raft_consensus.cc:686] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:32:50.920863 6235 consensus_queue.cc:237] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.929179 5827 tablet_bootstrap.cc:654] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:50.948688 6510 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:50.949131 6510 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.950966 6510 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:50.955336 5830 raft_consensus.cc:348] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.956282 5830 raft_consensus.cc:374] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:50.956615 5830 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:50.957371 5830 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:50.960847 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:50.961175 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:50.962394 5659 raft_consensus.cc:2379] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 1: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:32:50.967286 5721 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:50.975200 5830 ts_tablet_manager.cc:1428] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.115s user 0.006s sys 0.003s
I20260807 13:32:50.973523 6439 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:50.986773 5830 tablet_bootstrap.cc:492] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:50.999153 6502 consensus_queue.cc:1035] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:51.016187 5827 tablet_bootstrap.cc:492] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:51.016670 5827 ts_tablet_manager.cc:1397] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.102s user 0.016s sys 0.020s
I20260807 13:32:51.021185 6439 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:51.020615 5389 catalog_manager.cc:5495] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:51.024008 5830 tablet_bootstrap.cc:654] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:51.030192 5827 raft_consensus.cc:348] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.031049 5827 raft_consensus.cc:374] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:51.031342 5827 raft_consensus.cc:729] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:51.032045 5827 consensus_queue.cc:260] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.040549 5827 ts_tablet_manager.cc:1428] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.024s user 0.003s sys 0.003s
I20260807 13:32:51.042275 5827 tablet_bootstrap.cc:492] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf: Bootstrap starting.
I20260807 13:32:51.052547 5830 tablet_bootstrap.cc:492] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:51.052973 5830 ts_tablet_manager.cc:1397] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.074s user 0.012s sys 0.000s
I20260807 13:32:51.054399 6551 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:51.055721 5827 tablet_bootstrap.cc:654] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:51.055111 6551 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.060971 6434 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:51.061944 6434 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.065276 6434 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:51.068068 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:51.070178 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:51.071221 5661 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:51.073771 5499 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:51.075145 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:51.079727 6520 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:51.080304 6520 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:51.080883 6520 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.080914 5661 raft_consensus.cc:2379] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 1: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:32:51.093485 5499 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:32:51.094339 6453 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:51.101810 6376 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.104213 5830 raft_consensus.cc:348] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.105239 5830 raft_consensus.cc:374] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:51.105521 5830 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:51.106264 5830 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.109807 5830 ts_tablet_manager.cc:1428] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.057s user 0.007s sys 0.003s
I20260807 13:32:51.119840 5830 tablet_bootstrap.cc:492] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:51.122696 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:51.113695 6551 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:32:51.128970 5501 leader_election.cc:341] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:51.136047 5830 tablet_bootstrap.cc:654] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:51.139948 5827 tablet_bootstrap.cc:492] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf: No bootstrap required, opened a new log
I20260807 13:32:51.140376 5827 ts_tablet_manager.cc:1397] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent bootstrapping tablet: real 0.098s user 0.018s sys 0.014s
I20260807 13:32:51.140549 6510 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:51.140822 6376 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:51.141320 6510 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.143610 5827 raft_consensus.cc:348] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.144273 5827 raft_consensus.cc:374] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:51.144564 5827 raft_consensus.cc:729] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Initialized, Role: FOLLOWER
I20260807 13:32:51.145471 6510 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:51.147357 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:51.149549 6520 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.153257 6520 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:51.157373 5827 consensus_queue.cc:260] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:51.181677 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 51631.9us
I20260807 13:32:51.185669 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:32:51.189283 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:51.205667 5827 ts_tablet_manager.cc:1428] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent starting tablet: real 0.065s user 0.004s sys 0.003s
W20260807 13:32:51.221432 5501 leader_election.cc:341] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Illegal state: must be running to vote when last-logged opid is not known
I20260807 13:32:51.223357 5722 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:32:51.224699 6510 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 13:32:51.228615 5830 tablet_bootstrap.cc:492] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:51.229043 5830 ts_tablet_manager.cc:1397] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.109s user 0.020s sys 0.020s
W20260807 13:32:51.236925 5470 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 13:32:51.230077 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:51.243162 5659 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.242820 6439 consensus_queue.cc:1035] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:51.250327 6510 consensus_queue.cc:1035] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:51.237484 5830 raft_consensus.cc:348] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.256697 5830 raft_consensus.cc:374] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:51.259917 5830 raft_consensus.cc:729] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:51.260512 5830 consensus_queue.cc:260] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.290572 5830 ts_tablet_manager.cc:1428] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.061s user 0.003s sys 0.007s
I20260807 13:32:51.293963 5830 tablet_bootstrap.cc:492] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:51.288285 6594 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:51.314245 5659 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:51.316259 5762 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.325649 5830 tablet_bootstrap.cc:654] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:51.339275 5499 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:32:51.387606 6499 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:51.388187 6499 raft_consensus.cc:686] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:51.389087 6499 consensus_queue.cc:237] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:32:51.390592 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 51416.6us
I20260807 13:32:51.414914 5763 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.430255 5389 catalog_manager.cc:5495] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:51.467547 5830 tablet_bootstrap.cc:492] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:51.468093 5830 ts_tablet_manager.cc:1397] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.174s user 0.018s sys 0.017s
I20260807 13:32:51.470172 6594 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:32:51.470883 6594 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.471586 5830 raft_consensus.cc:348] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.472597 5830 raft_consensus.cc:374] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:51.472962 5830 raft_consensus.cc:729] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:51.474701 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:32:51.473656 5830 consensus_queue.cc:260] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.475705 5659 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:51.476584 6594 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:51.477799 5499 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:51.478698 6598 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 13:32:51.479285 6598 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:32:51.479879 6598 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.487021 5830 ts_tablet_manager.cc:1428] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260807 13:32:51.488248 5830 tablet_bootstrap.cc:492] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:51.504243 5762 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.512440 5830 tablet_bootstrap.cc:654] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:51.511210 6598 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.518610 6598 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:51.519464 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:32:51.522401 5662 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.542924 5830 tablet_bootstrap.cc:492] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:51.543215 5765 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.543463 5830 ts_tablet_manager.cc:1397] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.055s user 0.011s sys 0.012s
I20260807 13:32:51.576574 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:32:51.570540 5830 raft_consensus.cc:348] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.579139 5830 raft_consensus.cc:374] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:51.580202 5830 raft_consensus.cc:729] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:51.580783 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:32:51.586757 5830 consensus_queue.cc:260] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.590507 5767 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 0.
I20260807 13:32:51.597203 5830 ts_tablet_manager.cc:1428] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.051s user 0.008s sys 0.000s
I20260807 13:32:51.598423 5830 tablet_bootstrap.cc:492] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159: Bootstrap starting.
I20260807 13:32:51.601938 6235 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:51.590199 5662 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:32:51.608217 6516 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 13:32:51.609673 5499 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:32:51.610724 6434 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 13:32:51.626708 6434 raft_consensus.cc:686] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:32:51.632336 6434 consensus_queue.cc:237] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.644513 5830 tablet_bootstrap.cc:654] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159: Neither blocks nor log segments found. Creating new log.
I20260807 13:32:51.682004 5830 tablet_bootstrap.cc:492] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159: No bootstrap required, opened a new log
I20260807 13:32:51.682476 5830 ts_tablet_manager.cc:1397] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159: Time spent bootstrapping tablet: real 0.084s user 0.010s sys 0.006s
I20260807 13:32:51.684883 5830 raft_consensus.cc:348] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.685577 5830 raft_consensus.cc:374] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 13:32:51.685846 5830 raft_consensus.cc:729] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Initialized, Role: FOLLOWER
I20260807 13:32:51.697064 5394 catalog_manager.cc:5495] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:51.708786 5830 consensus_queue.cc:260] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:32:51.711140 5830 ts_tablet_manager.cc:1428] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260807 13:32:51.931411 5762 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:51.938627 6434 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:51.955837 6434 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:52.060098 5762 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 13:32:52.069018 6434 consensus_queue.cc:1035] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:52.093024 6514 consensus_queue.cc:1035] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 13:32:52.769711 3823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 13:32:52.796990 6624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:52.798431 6623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 13:32:52.800320 6628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 13:32:52.801776 3823 server_base.cc:1034] running on GCE node
I20260807 13:32:52.804886 3823 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 13:32:52.805197 3823 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 13:32:52.805405 3823 hybrid_clock.cc:648] HybridClock initialized: now 1786109572805393 us; error 0 us; skew 500 ppm
I20260807 13:32:52.806197 3823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 13:32:52.809952 3823 webserver.cc:460] Webserver started at http://127.3.187.196:46417/ using document root <none> and password file <none>
I20260807 13:32:52.810771 3823 fs_manager.cc:359] Metadata directory not provided
I20260807 13:32:52.811110 3823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 13:32:52.811597 3823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 13:32:52.813424 3823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-3-root/instance:
uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
format_stamp: "Formatted at 2026-08-07 13:32:52 on dist-test-slave-d17x"
I20260807 13:32:52.821847 3823 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260807 13:32:52.826612 6634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:52.827719 3823 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 13:32:52.828028 3823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-3-root
uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
format_stamp: "Formatted at 2026-08-07 13:32:52 on dist-test-slave-d17x"
I20260807 13:32:52.828301 3823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 13:32:52.843712 3823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 13:32:52.844931 3823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 13:32:52.846468 3823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 13:32:52.849462 3823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 13:32:52.849647 3823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:52.849845 3823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 13:32:52.849961 3823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 13:32:52.980181 3823 rpc_server.cc:307] RPC server started. Bound to: 127.3.187.196:41077
I20260807 13:32:52.980322 6738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.187.196:41077 every 8 connection(s)
I20260807 13:32:52.990698 3823 auto_leader_rebalancer-test.cc:413] add a tserver: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:32:53.021353 6739 heartbeater.cc:347] Connected to a master server at 127.3.187.254:34519
I20260807 13:32:53.021881 6739 heartbeater.cc:464] Registering TS with master...
I20260807 13:32:53.022601 6739 heartbeater.cc:511] Master 127.3.187.254:34519 requested a full tablet report, sending...
I20260807 13:32:53.024927 5391 ts_manager.cc:194] Registered new tserver with Master: d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:32:53.026757 5391 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36640
I20260807 13:32:53.369294 5662 consensus_queue.cc:237] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:53.378726 5554 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:53.383190 5762 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:53.386857 6582 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 13:32:53.391227 6516 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260807 13:32:53.426186 5621 consensus_peers.cc:487] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc4a6a8da3ec47dc859ce24a3852828d. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:53.425359 6582 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.430716 5762 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.432051 5554 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.465370 5391 catalog_manager.cc:5495] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.538367 5659 consensus_queue.cc:237] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
W20260807 13:32:53.588549 5621 consensus_peers.cc:487] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e73dd10d6fc4b29b9371e6df66c3ed0. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:53.591533 5762 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:53.597025 5543 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:53.599368 6582 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:53.601023 6516 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:53.638182 6762 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.640722 5543 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.649992 5765 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.674576 5394 catalog_manager.cc:5495] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:53.730553 5542 consensus_queue.cc:237] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:53.752177 5659 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:53.754805 5765 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:53.755901 6434 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:53.756860 6598 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:32:53.801584 6434 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.816679 5659 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
W20260807 13:32:53.821892 5503 consensus_peers.cc:487] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f4a8b1973984ea99cbc92ff5ba63770. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:53.843417 6783 ts_tablet_manager.cc:927] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:53.862918 5543 consensus_queue.cc:237] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:53.854862 5762 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.873402 5394 catalog_manager.cc:5495] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 13:32:53.880322 6783 tablet_copy_client.cc:316] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.194:42569
W20260807 13:32:53.926496 5503 consensus_peers.cc:487] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a473fdcfed54f57b127f9f85d46c8ea. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:53.935442 5762 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:53.937037 5662 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:53.937732 6745 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:32:53.939322 6785 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:32:53.949302 5683 tablet_copy_service.cc:140] P 0b9aca0aafaa43e7998ee8f3e59627e0: Received BeginTabletCopySession request for tablet dc4a6a8da3ec47dc859ce24a3852828d from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:48804)
I20260807 13:32:53.953650 5683 tablet_copy_service.cc:161] P 0b9aca0aafaa43e7998ee8f3e59627e0: Beginning new tablet copy session on tablet dc4a6a8da3ec47dc859ce24a3852828d from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:48804: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-dc4a6a8da3ec47dc859ce24a3852828d
I20260807 13:32:53.975946 5683 tablet_copy_source_session.cc:205] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:32:53.976042 6434 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.983387 6783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc4a6a8da3ec47dc859ce24a3852828d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:53.984215 5659 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:53.998203 5763 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:54.013818 5394 catalog_manager.cc:5495] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:54.029991 6739 heartbeater.cc:503] Master 127.3.187.254:34519 was elected leader, sending a full tablet report...
I20260807 13:32:54.033293 6783 tablet_copy_client.cc:791] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:32:54.034008 6783 tablet_copy_client.cc:655] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:32:54.044763 6783 tablet_copy_client.cc:531] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:32:54.056841 6783 tablet_bootstrap.cc:492] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:32:54.088514 6783 tablet_bootstrap.cc:492] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:32:54.089571 6783 tablet_bootstrap.cc:492] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:32:54.090552 6783 ts_tablet_manager.cc:1397] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.034s user 0.025s sys 0.008s
I20260807 13:32:54.096856 6783 raft_consensus.cc:348] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:54.097791 6783 raft_consensus.cc:729] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:32:54.098464 6783 consensus_queue.cc:260] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:54.116353 6783 ts_tablet_manager.cc:1428] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.025s user 0.013s sys 0.011s
I20260807 13:32:54.120635 5683 tablet_copy_service.cc:342] P 0b9aca0aafaa43e7998ee8f3e59627e0: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-dc4a6a8da3ec47dc859ce24a3852828d received from {username='slave'} at 127.0.0.1:48804
I20260807 13:32:54.121269 5683 tablet_copy_service.cc:433] P 0b9aca0aafaa43e7998ee8f3e59627e0: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-dc4a6a8da3ec47dc859ce24a3852828d on tablet dc4a6a8da3ec47dc859ce24a3852828d with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:32:54.190675 6783 ts_tablet_manager.cc:927] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:54.194522 6783 tablet_copy_client.cc:316] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.194:42569
I20260807 13:32:54.197041 5683 tablet_copy_service.cc:140] P 0b9aca0aafaa43e7998ee8f3e59627e0: Received BeginTabletCopySession request for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0 from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:48804)
I20260807 13:32:54.197942 5683 tablet_copy_service.cc:161] P 0b9aca0aafaa43e7998ee8f3e59627e0: Beginning new tablet copy session on tablet 8e73dd10d6fc4b29b9371e6df66c3ed0 from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:48804: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-8e73dd10d6fc4b29b9371e6df66c3ed0
I20260807 13:32:54.210094 5683 tablet_copy_source_session.cc:205] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:32:54.227123 6783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:54.234038 6696 raft_consensus.cc:1203] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:32:54.267351 6799 ts_tablet_manager.cc:927] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143)
I20260807 13:32:54.277408 6799 tablet_copy_client.cc:316] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.193:39143
I20260807 13:32:54.283135 6783 tablet_copy_client.cc:791] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:32:54.283924 6783 tablet_copy_client.cc:655] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:32:54.290745 6783 tablet_copy_client.cc:531] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:32:54.305179 6783 tablet_bootstrap.cc:492] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:32:54.308145 5574 tablet_copy_service.cc:140] P 14f62bf285c448b9b7a21fabd7a5f0bf: Received BeginTabletCopySession request for tablet 5f4a8b1973984ea99cbc92ff5ba63770 from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:46432)
I20260807 13:32:54.308735 5574 tablet_copy_service.cc:161] P 14f62bf285c448b9b7a21fabd7a5f0bf: Beginning new tablet copy session on tablet 5f4a8b1973984ea99cbc92ff5ba63770 from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:46432: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-5f4a8b1973984ea99cbc92ff5ba63770
I20260807 13:32:54.324569 5574 tablet_copy_source_session.cc:205] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:32:54.331140 6783 tablet_bootstrap.cc:492] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:32:54.331939 6783 tablet_bootstrap.cc:492] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:32:54.332535 6783 ts_tablet_manager.cc:1397] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.027s user 0.021s sys 0.005s
I20260807 13:32:54.337246 6799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f4a8b1973984ea99cbc92ff5ba63770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:54.337430 6783 raft_consensus.cc:348] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:54.338464 6783 raft_consensus.cc:729] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:32:54.339118 6783 consensus_queue.cc:260] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:54.343039 6783 ts_tablet_manager.cc:1428] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.010s user 0.007s sys 0.001s
I20260807 13:32:54.346849 5683 tablet_copy_service.cc:342] P 0b9aca0aafaa43e7998ee8f3e59627e0: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-8e73dd10d6fc4b29b9371e6df66c3ed0 received from {username='slave'} at 127.0.0.1:48804
I20260807 13:32:54.347436 5683 tablet_copy_service.cc:433] P 0b9aca0aafaa43e7998ee8f3e59627e0: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-8e73dd10d6fc4b29b9371e6df66c3ed0 on tablet 8e73dd10d6fc4b29b9371e6df66c3ed0 with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:32:54.376166 6799 tablet_copy_client.cc:791] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:32:54.376827 6799 tablet_copy_client.cc:655] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:32:54.387488 6799 tablet_copy_client.cc:531] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:32:54.400235 6799 tablet_bootstrap.cc:492] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:32:54.447369 6799 tablet_bootstrap.cc:492] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:32:54.448140 6783 ts_tablet_manager.cc:927] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143)
I20260807 13:32:54.448628 6799 tablet_bootstrap.cc:492] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:32:54.449671 6799 ts_tablet_manager.cc:1397] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.050s user 0.024s sys 0.018s
I20260807 13:32:54.458982 6799 raft_consensus.cc:348] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:54.460007 6799 raft_consensus.cc:729] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:32:54.460796 6799 consensus_queue.cc:260] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:54.463438 6799 ts_tablet_manager.cc:1428] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.013s user 0.004s sys 0.003s
I20260807 13:32:54.465853 5574 tablet_copy_service.cc:342] P 14f62bf285c448b9b7a21fabd7a5f0bf: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-5f4a8b1973984ea99cbc92ff5ba63770 received from {username='slave'} at 127.0.0.1:46432
I20260807 13:32:54.466415 5574 tablet_copy_service.cc:433] P 14f62bf285c448b9b7a21fabd7a5f0bf: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-5f4a8b1973984ea99cbc92ff5ba63770 on tablet 5f4a8b1973984ea99cbc92ff5ba63770 with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:32:54.479905 6783 tablet_copy_client.cc:316] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.193:39143
I20260807 13:32:54.482393 5574 tablet_copy_service.cc:140] P 14f62bf285c448b9b7a21fabd7a5f0bf: Received BeginTabletCopySession request for tablet 9a473fdcfed54f57b127f9f85d46c8ea from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:46432)
I20260807 13:32:54.483139 5574 tablet_copy_service.cc:161] P 14f62bf285c448b9b7a21fabd7a5f0bf: Beginning new tablet copy session on tablet 9a473fdcfed54f57b127f9f85d46c8ea from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:46432: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-9a473fdcfed54f57b127f9f85d46c8ea
I20260807 13:32:54.494066 5574 tablet_copy_source_session.cc:205] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:32:54.497905 6783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a473fdcfed54f57b127f9f85d46c8ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:54.521245 6783 tablet_copy_client.cc:791] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:32:54.521797 6783 tablet_copy_client.cc:655] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:32:54.525559 6783 tablet_copy_client.cc:531] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:32:54.537743 6783 tablet_bootstrap.cc:492] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:32:54.564805 6783 tablet_bootstrap.cc:492] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:32:54.565912 6783 tablet_bootstrap.cc:492] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:32:54.566576 6783 ts_tablet_manager.cc:1397] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.029s user 0.015s sys 0.012s
I20260807 13:32:54.571381 6783 raft_consensus.cc:348] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:54.572283 6783 raft_consensus.cc:729] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:32:54.572876 6783 consensus_queue.cc:260] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:54.580319 6783 ts_tablet_manager.cc:1428] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.013s user 0.003s sys 0.004s
I20260807 13:32:54.582002 5574 tablet_copy_service.cc:342] P 14f62bf285c448b9b7a21fabd7a5f0bf: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-9a473fdcfed54f57b127f9f85d46c8ea received from {username='slave'} at 127.0.0.1:46432
I20260807 13:32:54.582409 5574 tablet_copy_service.cc:433] P 14f62bf285c448b9b7a21fabd7a5f0bf: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-9a473fdcfed54f57b127f9f85d46c8ea on tablet 9a473fdcfed54f57b127f9f85d46c8ea with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:32:54.671064 6696 raft_consensus.cc:1203] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:32:54.754609 6696 raft_consensus.cc:1203] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:32:54.875504 6516 raft_consensus.cc:1050] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:32:54.896647 6516 consensus_queue.cc:237] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:54.930298 6696 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:54.932969 6810 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:54.937719 5762 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:54.944243 5542 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:54.944422 6762 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:54.945972 6516 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:54.993921 6694 raft_consensus.cc:1203] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:32:54.996891 6516 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.020376 6694 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.039429 5765 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.053054 5391 catalog_manager.cc:5495] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:32:55.105132 5548 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.176846 5659 consensus_queue.cc:237] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:55.187285 6694 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:55.189342 6818 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:32:55.195363 5765 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:55.197425 6818 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:55.199534 6582 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.203133 6694 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.206278 5765 raft_consensus.cc:2932] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.224344 5369 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet dc4a6a8da3ec47dc859ce24a3852828d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:32:55.233600 5391 catalog_manager.cc:5495] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.246683 5531 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a6a8da3ec47dc859ce24a3852828d with delete_type TABLET_DATA_TOMBSTONED (TS 14f62bf285c448b9b7a21fabd7a5f0bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54374
I20260807 13:32:55.249425 6828 tablet_replica.cc:330] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf: stopping tablet replica
I20260807 13:32:55.250643 6828 raft_consensus.cc:2229] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:55.254420 6828 raft_consensus.cc:2258] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:55.259483 6828 ts_tablet_manager.cc:1905] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:32:55.274154 6828 ts_tablet_manager.cc:1918] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:32:55.274755 6828 log.cc:1196] T dc4a6a8da3ec47dc859ce24a3852828d P 14f62bf285c448b9b7a21fabd7a5f0bf: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-0-root/wals/dc4a6a8da3ec47dc859ce24a3852828d
I20260807 13:32:55.277994 5372 catalog_manager.cc:4841] TS 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): tablet dc4a6a8da3ec47dc859ce24a3852828d (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:32:55.293255 6762 raft_consensus.cc:1050] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:32:55.295832 6762 consensus_queue.cc:237] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:55.306218 6694 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:55.306351 5763 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:55.308449 6582 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:55.310003 6582 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:55.310388 5548 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:55.311697 6516 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:55.335793 6766 raft_consensus.cc:1050] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:32:55.338433 6766 consensus_queue.cc:237] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:55.344780 6762 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.346416 5542 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.349702 5763 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.362147 6694 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.368615 5765 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:55.370165 6696 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:55.370085 6434 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:55.373288 6598 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:55.377539 5659 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:55.378898 6785 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:55.396337 5394 catalog_manager.cc:5495] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.433787 5665 consensus_queue.cc:237] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:55.432907 6785 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.455515 6696 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.466194 5763 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.476310 6694 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:55.477960 6516 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:55.485930 5391 catalog_manager.cc:5495] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:32:55.487740 5542 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:55.501847 6516 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:55.511325 5659 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.515022 6582 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.521617 5542 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.546995 6598 raft_consensus.cc:1050] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:32:55.548892 6598 consensus_queue.cc:237] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:55.548812 6694 raft_consensus.cc:2932] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.554471 5369 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:32:55.568439 5543 consensus_queue.cc:237] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:55.581498 6696 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:55.584088 6785 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:55.589572 6693 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:55.592145 6785 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:55.593883 6434 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.596932 5391 catalog_manager.cc:5495] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:32:55.605772 5659 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:55.610116 6694 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.615185 6785 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:55.617579 5767 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:55.619442 5764 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:55.628705 5372 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 5f4a8b1973984ea99cbc92ff5ba63770 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:32:55.633596 5744 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e73dd10d6fc4b29b9371e6df66c3ed0 with delete_type TABLET_DATA_TOMBSTONED (TS 737c581af06a42df94970a1542600159 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32948
I20260807 13:32:55.640627 6766 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.643298 5661 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.647744 6850 tablet_replica.cc:330] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159: stopping tablet replica
I20260807 13:32:55.648917 6850 raft_consensus.cc:2229] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:55.650489 6850 raft_consensus.cc:2258] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:55.659423 5389 catalog_manager.cc:5495] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.666819 6850 ts_tablet_manager.cc:1905] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:32:55.668357 6843 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:55.670655 6843 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:55.676326 5390 catalog_manager.cc:5495] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.686199 5646 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f4a8b1973984ea99cbc92ff5ba63770 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9aca0aafaa43e7998ee8f3e59627e0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52568
I20260807 13:32:55.688501 6850 ts_tablet_manager.cc:1918] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:32:55.689076 6850 log.cc:1196] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 737c581af06a42df94970a1542600159: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-2-root/wals/8e73dd10d6fc4b29b9371e6df66c3ed0
I20260807 13:32:55.691533 5373 catalog_manager.cc:4841] TS 737c581af06a42df94970a1542600159 (127.3.187.195:43427): tablet 8e73dd10d6fc4b29b9371e6df66c3ed0 (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:32:55.700139 5764 raft_consensus.cc:2932] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.720114 6694 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.726763 6851 tablet_replica.cc:330] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0: stopping tablet replica
I20260807 13:32:55.729219 6851 raft_consensus.cc:2229] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:55.730005 6851 raft_consensus.cc:2258] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:55.746759 5763 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:55.752435 6851 ts_tablet_manager.cc:1905] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:32:55.772976 6851 ts_tablet_manager.cc:1918] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:32:55.773366 6851 log.cc:1196] T 5f4a8b1973984ea99cbc92ff5ba63770 P 0b9aca0aafaa43e7998ee8f3e59627e0: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-1-root/wals/5f4a8b1973984ea99cbc92ff5ba63770
I20260807 13:32:55.775497 5369 catalog_manager.cc:4841] TS 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): tablet 5f4a8b1973984ea99cbc92ff5ba63770 (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:32:56.142350 5542 consensus_queue.cc:237] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:56.160104 6696 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:56.162971 5763 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:56.163815 6766 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:56.164734 6843 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:56.175136 6696 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:56.177737 6766 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:56.189478 5389 catalog_manager.cc:5495] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:56.213326 5763 raft_consensus.cc:2932] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:56.224445 5372 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 9a473fdcfed54f57b127f9f85d46c8ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:32:56.256353 5646 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a473fdcfed54f57b127f9f85d46c8ea with delete_type TABLET_DATA_TOMBSTONED (TS 0b9aca0aafaa43e7998ee8f3e59627e0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52568
I20260807 13:32:56.257615 6851 tablet_replica.cc:330] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0: stopping tablet replica
I20260807 13:32:56.258667 6851 raft_consensus.cc:2229] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:56.259254 6851 raft_consensus.cc:2258] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:56.262524 6851 ts_tablet_manager.cc:1905] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:32:56.278852 6851 ts_tablet_manager.cc:1918] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:32:56.279290 6851 log.cc:1196] T 9a473fdcfed54f57b127f9f85d46c8ea P 0b9aca0aafaa43e7998ee8f3e59627e0: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-1-root/wals/9a473fdcfed54f57b127f9f85d46c8ea
I20260807 13:32:56.280843 5369 catalog_manager.cc:4841] TS 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): tablet 9a473fdcfed54f57b127f9f85d46c8ea (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:32:57.362288 5763 consensus_queue.cc:237] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:57.369416 5661 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:57.371402 5554 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:57.373390 6773 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:57.376157 6859 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 13:32:57.408083 5725 consensus_peers.cc:487] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3bf6b4114cb4a07b86da2385fa903bc. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:57.409757 6859 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.411805 5554 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.414218 5659 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.427718 5542 consensus_queue.cc:237] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:57.435968 5390 catalog_manager.cc:5495] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260807 13:32:57.463343 5503 consensus_peers.cc:487] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a1250a61f1842c192fd95f3a267926f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:57.463522 5763 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:57.464862 6865 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:57.472052 5661 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:57.474726 6865 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:57.489252 6598 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.492683 5763 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.505190 5661 consensus_queue.cc:237] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:57.509917 5659 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
W20260807 13:32:57.537323 5621 consensus_peers.cc:487] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fee77ea2bf842b780a8cbcaf0698bc3. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:57.536989 5390 catalog_manager.cc:5495] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.539486 5763 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:57.544035 6582 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:57.583272 6582 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.586786 5542 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:57.586323 5763 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.598666 6860 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:57.598453 5542 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:57.613220 5390 catalog_manager.cc:5495] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
W20260807 13:32:57.689175 5503 consensus_peers.cc:487] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03cc5aef20f549689e8b1ba7db0effed. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:32:57.699606 5659 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:57.702287 5543 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.705686 6598 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:32:57.710187 5764 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:32:57.725289 6598 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.732236 5659 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.754146 5389 catalog_manager.cc:5495] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.758154 6895 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:32:57.785032 5763 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:32:57.907370 6915 ts_tablet_manager.cc:927] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:32:57.909166 6915 tablet_copy_client.cc:316] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.195:43427
I20260807 13:32:57.938651 5785 tablet_copy_service.cc:140] P 737c581af06a42df94970a1542600159: Received BeginTabletCopySession request for tablet f3bf6b4114cb4a07b86da2385fa903bc from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:47820)
I20260807 13:32:57.939230 5785 tablet_copy_service.cc:161] P 737c581af06a42df94970a1542600159: Beginning new tablet copy session on tablet f3bf6b4114cb4a07b86da2385fa903bc from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:47820: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-f3bf6b4114cb4a07b86da2385fa903bc
I20260807 13:32:57.948375 5785 tablet_copy_source_session.cc:205] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:32:57.951552 6915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3bf6b4114cb4a07b86da2385fa903bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:57.962150 6921 ts_tablet_manager.cc:927] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143)
I20260807 13:32:57.969610 6915 tablet_copy_client.cc:791] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:32:57.970237 6915 tablet_copy_client.cc:655] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:32:57.976866 6915 tablet_copy_client.cc:531] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:32:57.985054 6915 tablet_bootstrap.cc:492] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:32:58.009654 6921 tablet_copy_client.cc:316] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.193:39143
I20260807 13:32:58.011691 5574 tablet_copy_service.cc:140] P 14f62bf285c448b9b7a21fabd7a5f0bf: Received BeginTabletCopySession request for tablet 3a1250a61f1842c192fd95f3a267926f from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:46432)
I20260807 13:32:58.012204 5574 tablet_copy_service.cc:161] P 14f62bf285c448b9b7a21fabd7a5f0bf: Beginning new tablet copy session on tablet 3a1250a61f1842c192fd95f3a267926f from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:46432: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-3a1250a61f1842c192fd95f3a267926f
I20260807 13:32:58.021517 6915 tablet_bootstrap.cc:492] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:32:58.022818 6915 tablet_bootstrap.cc:492] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:32:58.023523 6915 ts_tablet_manager.cc:1397] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.039s user 0.024s sys 0.000s
I20260807 13:32:58.025527 5574 tablet_copy_source_session.cc:205] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:32:58.026467 6915 raft_consensus.cc:348] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:58.027405 6915 raft_consensus.cc:729] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:32:58.028188 6915 consensus_queue.cc:260] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:58.030360 6921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1250a61f1842c192fd95f3a267926f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:58.049851 6915 ts_tablet_manager.cc:1428] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.026s user 0.019s sys 0.004s
I20260807 13:32:58.052124 5785 tablet_copy_service.cc:342] P 737c581af06a42df94970a1542600159: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-f3bf6b4114cb4a07b86da2385fa903bc received from {username='slave'} at 127.0.0.1:47820
I20260807 13:32:58.052557 5785 tablet_copy_service.cc:433] P 737c581af06a42df94970a1542600159: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-f3bf6b4114cb4a07b86da2385fa903bc on tablet f3bf6b4114cb4a07b86da2385fa903bc with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:32:58.062377 6921 tablet_copy_client.cc:791] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:32:58.062995 6921 tablet_copy_client.cc:655] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:32:58.068445 6921 tablet_copy_client.cc:531] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:32:58.077840 6921 tablet_bootstrap.cc:492] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:32:58.095690 6921 tablet_bootstrap.cc:492] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:32:58.096333 6921 tablet_bootstrap.cc:492] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:32:58.096940 6921 ts_tablet_manager.cc:1397] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.019s user 0.015s sys 0.004s
I20260807 13:32:58.099179 6921 raft_consensus.cc:348] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:58.099931 6921 raft_consensus.cc:729] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:32:58.100407 6921 consensus_queue.cc:260] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:58.102530 6921 ts_tablet_manager.cc:1428] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260807 13:32:58.105005 5574 tablet_copy_service.cc:342] P 14f62bf285c448b9b7a21fabd7a5f0bf: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-3a1250a61f1842c192fd95f3a267926f received from {username='slave'} at 127.0.0.1:46432
I20260807 13:32:58.105376 5574 tablet_copy_service.cc:433] P 14f62bf285c448b9b7a21fabd7a5f0bf: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-3a1250a61f1842c192fd95f3a267926f on tablet 3a1250a61f1842c192fd95f3a267926f with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:32:58.160681 6921 ts_tablet_manager.cc:927] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:32:58.162771 6921 tablet_copy_client.cc:316] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.194:42569
I20260807 13:32:58.164535 5683 tablet_copy_service.cc:140] P 0b9aca0aafaa43e7998ee8f3e59627e0: Received BeginTabletCopySession request for tablet 5fee77ea2bf842b780a8cbcaf0698bc3 from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:48804)
I20260807 13:32:58.165053 5683 tablet_copy_service.cc:161] P 0b9aca0aafaa43e7998ee8f3e59627e0: Beginning new tablet copy session on tablet 5fee77ea2bf842b780a8cbcaf0698bc3 from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:48804: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-5fee77ea2bf842b780a8cbcaf0698bc3
I20260807 13:32:58.171854 5683 tablet_copy_source_session.cc:205] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:32:58.174662 6921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fee77ea2bf842b780a8cbcaf0698bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:58.188184 6921 tablet_copy_client.cc:791] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:32:58.188725 6921 tablet_copy_client.cc:655] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:32:58.191952 6921 tablet_copy_client.cc:531] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:32:58.199679 6921 tablet_bootstrap.cc:492] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:32:58.218657 6921 tablet_bootstrap.cc:492] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:32:58.219339 6921 tablet_bootstrap.cc:492] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:32:58.219969 6921 ts_tablet_manager.cc:1397] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.008s
I20260807 13:32:58.222448 6921 raft_consensus.cc:348] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:58.223294 6921 raft_consensus.cc:729] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:32:58.223914 6921 consensus_queue.cc:260] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:58.226140 6921 ts_tablet_manager.cc:1428] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 13:32:58.227789 5683 tablet_copy_service.cc:342] P 0b9aca0aafaa43e7998ee8f3e59627e0: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-5fee77ea2bf842b780a8cbcaf0698bc3 received from {username='slave'} at 127.0.0.1:48804
I20260807 13:32:58.228163 5683 tablet_copy_service.cc:433] P 0b9aca0aafaa43e7998ee8f3e59627e0: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-5fee77ea2bf842b780a8cbcaf0698bc3 on tablet 5fee77ea2bf842b780a8cbcaf0698bc3 with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:32:58.264968 6921 ts_tablet_manager.cc:927] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143)
I20260807 13:32:58.278453 6921 tablet_copy_client.cc:316] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.193:39143
I20260807 13:32:58.281142 5574 tablet_copy_service.cc:140] P 14f62bf285c448b9b7a21fabd7a5f0bf: Received BeginTabletCopySession request for tablet 03cc5aef20f549689e8b1ba7db0effed from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:46432)
I20260807 13:32:58.281622 5574 tablet_copy_service.cc:161] P 14f62bf285c448b9b7a21fabd7a5f0bf: Beginning new tablet copy session on tablet 03cc5aef20f549689e8b1ba7db0effed from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:46432: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-03cc5aef20f549689e8b1ba7db0effed
I20260807 13:32:58.286774 5574 tablet_copy_source_session.cc:205] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:32:58.289433 6921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03cc5aef20f549689e8b1ba7db0effed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:32:58.304840 6921 tablet_copy_client.cc:791] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:32:58.305332 6921 tablet_copy_client.cc:655] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:32:58.306306 6696 raft_consensus.cc:1203] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:32:58.312722 6921 tablet_copy_client.cc:531] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:32:58.321641 6921 tablet_bootstrap.cc:492] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:32:58.337325 6921 tablet_bootstrap.cc:492] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:32:58.337976 6921 tablet_bootstrap.cc:492] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:32:58.338544 6921 ts_tablet_manager.cc:1397] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.017s user 0.018s sys 0.001s
I20260807 13:32:58.340444 6921 raft_consensus.cc:348] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:58.341090 6921 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:32:58.341655 6921 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:32:58.344609 6921 ts_tablet_manager.cc:1428] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 13:32:58.347430 5574 tablet_copy_service.cc:342] P 14f62bf285c448b9b7a21fabd7a5f0bf: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-03cc5aef20f549689e8b1ba7db0effed received from {username='slave'} at 127.0.0.1:46432
I20260807 13:32:58.347857 5574 tablet_copy_service.cc:433] P 14f62bf285c448b9b7a21fabd7a5f0bf: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-03cc5aef20f549689e8b1ba7db0effed on tablet 03cc5aef20f549689e8b1ba7db0effed with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:32:58.369642 6696 raft_consensus.cc:1203] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:32:58.586651 6696 raft_consensus.cc:1203] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:32:58.753111 6913 raft_consensus.cc:1050] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:32:58.755429 6913 consensus_queue.cc:237] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:58.768478 6696 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:58.769948 6913 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:58.769495 5662 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:58.771939 6895 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:58.774228 5763 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:58.779929 6913 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 13:32:58.783906 6932 raft_consensus.cc:1050] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:32:58.788589 6694 raft_consensus.cc:1203] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:32:58.789253 6932 consensus_queue.cc:237] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:58.820932 6913 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.834393 5665 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:58.832823 6696 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.836153 6932 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:58.836350 6694 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:58.836566 5543 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:58.838007 6933 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:58.839674 6933 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:58.840011 5665 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.864988 5390 catalog_manager.cc:5495] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.865737 5767 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.895366 6773 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.897795 5543 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.898064 5659 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.908378 6696 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.920558 5545 consensus_queue.cc:237] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:58.933982 5394 catalog_manager.cc:5495] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.942689 6696 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:58.944249 6895 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:58.967276 5665 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:58.968423 6895 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.974859 6913 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:58.985443 5372 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 3a1250a61f1842c192fd95f3a267926f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:32:58.990520 6696 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:58.994211 5389 catalog_manager.cc:5495] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:32:58.995257 5767 consensus_queue.cc:237] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:59.004061 5744 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a1250a61f1842c192fd95f3a267926f with delete_type TABLET_DATA_TOMBSTONED (TS 737c581af06a42df94970a1542600159 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32948
I20260807 13:32:59.009917 6694 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:59.011782 6773 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:59.012421 5665 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:59.014752 6773 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:59.023139 6901 raft_consensus.cc:1050] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:32:59.023372 6932 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.025542 6901 consensus_queue.cc:237] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:59.034536 5373 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f3bf6b4114cb4a07b86da2385fa903bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:32:59.038291 5659 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.041473 6957 tablet_replica.cc:330] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159: stopping tablet replica
I20260807 13:32:59.042618 6957 raft_consensus.cc:2229] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:59.058947 6957 raft_consensus.cc:2258] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:59.065201 6696 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:59.085162 6957 ts_tablet_manager.cc:1905] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:32:59.092271 5390 catalog_manager.cc:5495] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.092665 6696 raft_consensus.cc:2932] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.111927 5531 tablet_service.cc:1514] Processing DeleteTablet for tablet f3bf6b4114cb4a07b86da2385fa903bc with delete_type TABLET_DATA_TOMBSTONED (TS 14f62bf285c448b9b7a21fabd7a5f0bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54374
I20260807 13:32:59.113605 6860 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:59.123920 6957 ts_tablet_manager.cc:1918] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:32:59.124452 6957 log.cc:1196] T 3a1250a61f1842c192fd95f3a267926f P 737c581af06a42df94970a1542600159: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-2-root/wals/3a1250a61f1842c192fd95f3a267926f
I20260807 13:32:59.125929 5373 catalog_manager.cc:4841] TS 737c581af06a42df94970a1542600159 (127.3.187.195:43427): tablet 3a1250a61f1842c192fd95f3a267926f (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:32:59.128100 5767 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:59.131819 5659 raft_consensus.cc:2932] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.139973 6964 tablet_replica.cc:330] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf: stopping tablet replica
I20260807 13:32:59.140686 6962 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:59.151602 5543 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:59.159956 6860 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:32:59.162499 6964 raft_consensus.cc:2229] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:59.163379 6964 raft_consensus.cc:2258] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:59.161823 6860 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.167325 6964 ts_tablet_manager.cc:1905] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:32:59.178874 6938 raft_consensus.cc:1050] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:32:59.180159 6694 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.182032 6938 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:59.206306 6964 ts_tablet_manager.cc:1918] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:32:59.206744 6964 log.cc:1196] T f3bf6b4114cb4a07b86da2385fa903bc P 14f62bf285c448b9b7a21fabd7a5f0bf: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-0-root/wals/f3bf6b4114cb4a07b86da2385fa903bc
I20260807 13:32:59.207652 5389 catalog_manager.cc:5495] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.208463 5372 catalog_manager.cc:4841] TS 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): tablet f3bf6b4114cb4a07b86da2385fa903bc (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:32:59.213140 5764 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.227460 5545 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.234489 5661 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:59.235832 5659 consensus_queue.cc:237] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:59.237350 5767 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:59.237471 6954 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:59.241128 6696 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:59.242254 6694 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:32:59.242525 6860 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:32:59.246179 6938 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260807 13:32:59.250069 5764 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:59.249270 6860 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.250535 6954 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:32:59.252481 6972 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:32:59.262593 6693 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.273152 5369 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 5fee77ea2bf842b780a8cbcaf0698bc3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:32:59.272262 5764 raft_consensus.cc:2932] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.294715 5389 catalog_manager.cc:5495] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 3 to 4, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.313865 5661 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.311352 6938 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.324554 5531 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fee77ea2bf842b780a8cbcaf0698bc3 with delete_type TABLET_DATA_TOMBSTONED (TS 14f62bf285c448b9b7a21fabd7a5f0bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54374
I20260807 13:32:59.325527 6964 tablet_replica.cc:330] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf: stopping tablet replica
I20260807 13:32:59.327247 6964 raft_consensus.cc:2229] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:59.331584 6964 raft_consensus.cc:2258] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:59.336108 6964 ts_tablet_manager.cc:1905] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:32:59.338923 6694 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.342389 5767 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.349666 5390 catalog_manager.cc:5495] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:32:59.363364 6964 ts_tablet_manager.cc:1918] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:32:59.363742 6964 log.cc:1196] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 14f62bf285c448b9b7a21fabd7a5f0bf: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-0-root/wals/5fee77ea2bf842b780a8cbcaf0698bc3
I20260807 13:32:59.365110 5372 catalog_manager.cc:4841] TS 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): tablet 5fee77ea2bf842b780a8cbcaf0698bc3 (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:32:59.374498 5543 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:32:59.386216 5659 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:59.386195 6694 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:32:59.387766 6895 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:32:59.391845 6954 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:32:59.401039 6913 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.404227 6694 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.416476 5372 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 03cc5aef20f549689e8b1ba7db0effed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:32:59.423149 5659 raft_consensus.cc:2932] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.427637 5389 catalog_manager.cc:5495] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 3 to 4, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:32:59.454253 5744 tablet_service.cc:1514] Processing DeleteTablet for tablet 03cc5aef20f549689e8b1ba7db0effed with delete_type TABLET_DATA_TOMBSTONED (TS 737c581af06a42df94970a1542600159 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32948
I20260807 13:32:59.455683 6957 tablet_replica.cc:330] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159: stopping tablet replica
I20260807 13:32:59.457752 6957 raft_consensus.cc:2229] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:32:59.459120 6957 raft_consensus.cc:2258] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:32:59.463078 6957 ts_tablet_manager.cc:1905] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:32:59.488142 6957 ts_tablet_manager.cc:1918] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:32:59.488806 6957 log.cc:1196] T 03cc5aef20f549689e8b1ba7db0effed P 737c581af06a42df94970a1542600159: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-2-root/wals/03cc5aef20f549689e8b1ba7db0effed
I20260807 13:32:59.491178 5373 catalog_manager.cc:4841] TS 737c581af06a42df94970a1542600159 (127.3.187.195:43427): tablet 03cc5aef20f549689e8b1ba7db0effed (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:33:00.492439 5763 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:00.500710 5661 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 13:33:00.500797 5725 consensus_peers.cc:487] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41befa481a284977a33f2f54ba55af62. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:33:00.502167 5548 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:33:00.502039 6932 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:00.503861 6985 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:00.517822 6995 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.520116 5543 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.526887 5661 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.540302 5390 catalog_manager.cc:5495] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:00.548776 5543 consensus_queue.cc:237] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
W20260807 13:33:00.564814 5503 consensus_peers.cc:487] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc6f41d0f11d4c6295bae40c23631a4a. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:33:00.565634 5661 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:33:00.566869 5763 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:33:00.569288 6988 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:00.570770 7000 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:00.598740 6913 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.614528 5767 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.633253 5661 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:00.640745 5394 catalog_manager.cc:5495] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:00.642808 5659 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.667235 5764 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:33:00.668984 6860 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:00.669296 5543 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 13:33:00.670086 5621 consensus_peers.cc:487] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93d548887d4245c7b22072e49517a84f. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:33:00.670794 7013 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:00.693200 6860 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.695930 5543 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.705304 5545 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:00.711596 5767 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.717868 5390 catalog_manager.cc:5495] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.719540 5661 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 13:33:00.721479 5503 consensus_peers.cc:487] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf -> Peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Couldn't send request to peer d6b8ccce5b91423b8673ddfbbf2c1b1c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c61e1dd5b00c43d2a1747f4832ac333c. This is attempt 1: this message will repeat every 5th retry.
I20260807 13:33:00.723393 5763 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 13:33:00.723871 7000 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:00.726289 6954 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:00.739822 7018 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.742308 5764 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.746810 5661 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } } }
I20260807 13:33:00.763554 5394 catalog_manager.cc:5495] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index -1 to 2, NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) added. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:00.907431 7029 ts_tablet_manager.cc:927] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:00.909567 7029 tablet_copy_client.cc:316] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.195:43427
I20260807 13:33:00.911526 5785 tablet_copy_service.cc:140] P 737c581af06a42df94970a1542600159: Received BeginTabletCopySession request for tablet 41befa481a284977a33f2f54ba55af62 from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:47820)
I20260807 13:33:00.912061 5785 tablet_copy_service.cc:161] P 737c581af06a42df94970a1542600159: Beginning new tablet copy session on tablet 41befa481a284977a33f2f54ba55af62 from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:47820: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-41befa481a284977a33f2f54ba55af62
I20260807 13:33:00.919304 5785 tablet_copy_source_session.cc:205] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:33:00.921964 7029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41befa481a284977a33f2f54ba55af62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:33:00.935186 7029 tablet_copy_client.cc:791] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:33:00.935720 7029 tablet_copy_client.cc:655] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:33:00.939596 7029 tablet_copy_client.cc:531] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:33:00.946660 7029 tablet_bootstrap.cc:492] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:33:00.965093 7029 tablet_bootstrap.cc:492] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:33:00.965888 7029 tablet_bootstrap.cc:492] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:33:00.966538 7029 ts_tablet_manager.cc:1397] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.020s user 0.019s sys 0.000s
I20260807 13:33:00.968652 7029 raft_consensus.cc:348] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:00.969447 7029 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:33:00.969985 7029 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:00.973112 7029 ts_tablet_manager.cc:1428] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260807 13:33:00.974686 5785 tablet_copy_service.cc:342] P 737c581af06a42df94970a1542600159: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-41befa481a284977a33f2f54ba55af62 received from {username='slave'} at 127.0.0.1:47820
I20260807 13:33:00.975068 5785 tablet_copy_service.cc:433] P 737c581af06a42df94970a1542600159: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-41befa481a284977a33f2f54ba55af62 on tablet 41befa481a284977a33f2f54ba55af62 with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:01.154807 7029 ts_tablet_manager.cc:927] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143)
I20260807 13:33:01.156664 7029 tablet_copy_client.cc:316] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.193:39143
I20260807 13:33:01.158078 5574 tablet_copy_service.cc:140] P 14f62bf285c448b9b7a21fabd7a5f0bf: Received BeginTabletCopySession request for tablet fc6f41d0f11d4c6295bae40c23631a4a from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:46432)
I20260807 13:33:01.158568 5574 tablet_copy_service.cc:161] P 14f62bf285c448b9b7a21fabd7a5f0bf: Beginning new tablet copy session on tablet fc6f41d0f11d4c6295bae40c23631a4a from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:46432: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-fc6f41d0f11d4c6295bae40c23631a4a
I20260807 13:33:01.164638 5574 tablet_copy_source_session.cc:205] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:33:01.167220 7029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc6f41d0f11d4c6295bae40c23631a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:33:01.180873 7029 tablet_copy_client.cc:791] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:33:01.181365 7029 tablet_copy_client.cc:655] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:33:01.185424 7029 tablet_copy_client.cc:531] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:33:01.189096 7035 ts_tablet_manager.cc:927] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143)
I20260807 13:33:01.190763 7035 tablet_copy_client.cc:316] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.193:39143
I20260807 13:33:01.192541 5574 tablet_copy_service.cc:140] P 14f62bf285c448b9b7a21fabd7a5f0bf: Received BeginTabletCopySession request for tablet c61e1dd5b00c43d2a1747f4832ac333c from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:46432)
I20260807 13:33:01.193086 5574 tablet_copy_service.cc:161] P 14f62bf285c448b9b7a21fabd7a5f0bf: Beginning new tablet copy session on tablet c61e1dd5b00c43d2a1747f4832ac333c from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:46432: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-c61e1dd5b00c43d2a1747f4832ac333c
I20260807 13:33:01.197186 7029 tablet_bootstrap.cc:492] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:33:01.201824 5574 tablet_copy_source_session.cc:205] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:33:01.203861 7039 ts_tablet_manager.cc:927] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Initiating tablet copy from peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:01.206198 7035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c61e1dd5b00c43d2a1747f4832ac333c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:33:01.213449 7039 tablet_copy_client.cc:316] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Beginning tablet copy session from remote peer at address 127.3.187.194:42569
I20260807 13:33:01.216043 5683 tablet_copy_service.cc:140] P 0b9aca0aafaa43e7998ee8f3e59627e0: Received BeginTabletCopySession request for tablet 93d548887d4245c7b22072e49517a84f from peer d6b8ccce5b91423b8673ddfbbf2c1b1c ({username='slave'} at 127.0.0.1:48804)
I20260807 13:33:01.216552 5683 tablet_copy_service.cc:161] P 0b9aca0aafaa43e7998ee8f3e59627e0: Beginning new tablet copy session on tablet 93d548887d4245c7b22072e49517a84f from peer d6b8ccce5b91423b8673ddfbbf2c1b1c at {username='slave'} at 127.0.0.1:48804: session id = d6b8ccce5b91423b8673ddfbbf2c1b1c-93d548887d4245c7b22072e49517a84f
I20260807 13:33:01.224462 5683 tablet_copy_source_session.cc:205] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 13:33:01.228226 7035 tablet_copy_client.cc:791] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:33:01.228886 7039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93d548887d4245c7b22072e49517a84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 13:33:01.228889 7035 tablet_copy_client.cc:655] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:33:01.240243 7029 tablet_bootstrap.cc:492] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:33:01.243963 7029 tablet_bootstrap.cc:492] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:33:01.244553 7029 ts_tablet_manager.cc:1397] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.048s user 0.012s sys 0.018s
I20260807 13:33:01.244747 7035 tablet_copy_client.cc:531] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:33:01.247349 7029 raft_consensus.cc:348] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:01.248355 7029 raft_consensus.cc:729] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:33:01.248713 7039 tablet_copy_client.cc:791] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 0 data blocks...
I20260807 13:33:01.249226 7039 tablet_copy_client.cc:655] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Starting download of 1 WAL segments...
I20260807 13:33:01.249305 7029 consensus_queue.cc:260] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:01.253886 7035 tablet_bootstrap.cc:492] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:33:01.253985 7039 tablet_copy_client.cc:531] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 13:33:01.254858 7029 ts_tablet_manager.cc:1428] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 13:33:01.258643 5574 tablet_copy_service.cc:342] P 14f62bf285c448b9b7a21fabd7a5f0bf: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-fc6f41d0f11d4c6295bae40c23631a4a received from {username='slave'} at 127.0.0.1:46432
I20260807 13:33:01.259011 5574 tablet_copy_service.cc:433] P 14f62bf285c448b9b7a21fabd7a5f0bf: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-fc6f41d0f11d4c6295bae40c23631a4a on tablet fc6f41d0f11d4c6295bae40c23631a4a with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:01.267710 7039 tablet_bootstrap.cc:492] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap starting.
I20260807 13:33:01.295465 7035 tablet_bootstrap.cc:492] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:33:01.296149 7035 tablet_bootstrap.cc:492] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:33:01.296729 7035 ts_tablet_manager.cc:1397] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.043s user 0.019s sys 0.001s
I20260807 13:33:01.297968 7039 tablet_bootstrap.cc:492] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 13:33:01.298808 7039 tablet_bootstrap.cc:492] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Bootstrap complete.
I20260807 13:33:01.298839 7035 raft_consensus.cc:348] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:01.299811 7039 ts_tablet_manager.cc:1397] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent bootstrapping tablet: real 0.032s user 0.016s sys 0.009s
I20260807 13:33:01.299767 7035 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:33:01.300525 7035 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:01.303658 7035 ts_tablet_manager.cc:1428] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 13:33:01.303329 7039 raft_consensus.cc:348] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:01.304152 7039 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Initialized, Role: LEARNER
I20260807 13:33:01.305434 5574 tablet_copy_service.cc:342] P 14f62bf285c448b9b7a21fabd7a5f0bf: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-c61e1dd5b00c43d2a1747f4832ac333c received from {username='slave'} at 127.0.0.1:46432
I20260807 13:33:01.305824 5574 tablet_copy_service.cc:433] P 14f62bf285c448b9b7a21fabd7a5f0bf: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-c61e1dd5b00c43d2a1747f4832ac333c on tablet c61e1dd5b00c43d2a1747f4832ac333c with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:01.304764 7039 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:01.308411 7039 ts_tablet_manager.cc:1428] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 13:33:01.311112 5683 tablet_copy_service.cc:342] P 0b9aca0aafaa43e7998ee8f3e59627e0: Request end of tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-93d548887d4245c7b22072e49517a84f received from {username='slave'} at 127.0.0.1:48804
I20260807 13:33:01.311512 5683 tablet_copy_service.cc:433] P 0b9aca0aafaa43e7998ee8f3e59627e0: ending tablet copy session d6b8ccce5b91423b8673ddfbbf2c1b1c-93d548887d4245c7b22072e49517a84f on tablet 93d548887d4245c7b22072e49517a84f with peer d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:01.417073 6694 raft_consensus.cc:1203] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:33:01.605872 6694 raft_consensus.cc:1203] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:33:01.694841 6694 raft_consensus.cc:1203] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:33:01.739180 6694 raft_consensus.cc:1203] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 13:33:01.834445 6996 raft_consensus.cc:1050] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:33:01.836668 6996 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:01.843475 5662 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:01.843525 6694 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:01.845327 6995 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:01.846403 6996 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:01.853008 5543 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:01.855702 6996 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:01.867022 6694 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:01.867749 5543 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:01.864807 6996 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:01.882249 5389 catalog_manager.cc:5495] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:01.905764 5662 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:01.943871 5767 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:01.948830 5548 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:33:01.951531 6694 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:33:01.952764 6995 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:01.955269 6996 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:01.958993 7056 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:01.966735 5543 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:01.970614 6694 raft_consensus.cc:2932] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:01.977319 5373 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 41befa481a284977a33f2f54ba55af62 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:33:01.982254 5391 catalog_manager.cc:5495] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New cstate: current_term: 1 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:01.997671 5646 tablet_service.cc:1514] Processing DeleteTablet for tablet 41befa481a284977a33f2f54ba55af62 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9aca0aafaa43e7998ee8f3e59627e0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52568
I20260807 13:33:02.003494 7062 tablet_replica.cc:330] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0: stopping tablet replica
I20260807 13:33:02.004446 7062 raft_consensus.cc:2229] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 13:33:02.005148 7062 raft_consensus.cc:2258] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 13:33:02.008669 7062 ts_tablet_manager.cc:1905] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:33:02.021234 7062 ts_tablet_manager.cc:1918] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:33:02.021584 7062 log.cc:1196] T 41befa481a284977a33f2f54ba55af62 P 0b9aca0aafaa43e7998ee8f3e59627e0: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-1-root/wals/41befa481a284977a33f2f54ba55af62
I20260807 13:33:02.023089 5369 catalog_manager.cc:4841] TS 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): tablet 41befa481a284977a33f2f54ba55af62 (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:33:02.104651 6954 raft_consensus.cc:1050] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:33:02.106731 6954 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:02.115715 6694 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:02.116748 5764 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:02.116937 5662 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:02.117842 7019 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:02.118780 7000 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:02.119550 6954 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:02.140523 6954 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:02.142257 5764 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:02.158571 7043 raft_consensus.cc:1050] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:33:02.160655 7043 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:02.161859 5390 catalog_manager.cc:5495] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:02.176167 7019 raft_consensus.cc:1050] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: attempting to promote NON_VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c to VOTER
I20260807 13:33:02.210354 7019 consensus_queue.cc:237] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:02.212939 5659 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:02.216686 6694 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:02.218775 6696 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:02.218076 7043 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260807 13:33:02.246752 5764 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260807 13:33:03.320087 5659 consensus_meta.cc:287] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.105s user 0.006s sys 0.013s
I20260807 13:33:03.323462 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 997) took 1112 ms. Trace:
I20260807 13:33:03.323855 5659 rpcz_store.cc:276] 0807 13:33:02.211474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:02.212276 (+ 802us) service_pool.cc:227] Handling call
0807 13:33:02.212563 (+ 287us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:02.212826 (+ 263us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:03.320647 (+1107821us) log.cc:842] Serialized 14 byte log entry
0807 13:33:03.323075 (+ 2428us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:03.323141 (+ 66us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:03.323186 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:03.323258 (+ 72us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:03.323381 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1672,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":120,"thread_start_us":2046,"threads_started":2,"wal-append.queue_time_us":1237}
I20260807 13:33:03.350894 7081 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.351588 7081 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.353885 7081 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.358527 7083 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.358958 7081 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.358610 7082 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.359229 7083 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.359498 7081 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:03.359769 7082 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.361968 7082 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.367295 7082 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.358160 7084 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.362296 7081 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:03.368948 7081 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.367954 7082 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.370011 7081 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.374148 7082 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.374619 7081 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.362308 7083 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.375669 7084 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:03.379002 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 1.15813e+06us
I20260807 13:33:03.379148 7084 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.391448 7000 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.395707 7000 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.403287 7085 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.404187 7085 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.417003 7083 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.408504 7085 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.408762 7084 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.449616 7087 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.450194 7087 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.429596 7084 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.455547 7084 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.419368 7083 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:03.456979 5500 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.267s user 0.010s sys 0.011s
I20260807 13:33:03.453846 7087 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:03.471607 5500 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.281s user 0.010s sys 0.012s
I20260807 13:33:03.493811 7093 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.492340 7081 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.494663 7093 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.494881 7081 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.500869 7093 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:03.504314 7085 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.504004 7092 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.505326 7091 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.505506 7095 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.527374 7084 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.527400 7085 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.546489 7085 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.528851 7081 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.529212 7083 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.527431 7100 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.539476 7087 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.563699 7103 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.554124 7082 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.529125 7084 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.528751 7091 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.528621 7092 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.573885 7079 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.565618 7081 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.565940 7085 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.528851 7095 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.570464 7082 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.583532 7106 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.567324 7087 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.586313 7120 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.586467 7111 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.586714 7084 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.588871 6954 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.574424 7079 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.583374 7094 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.579849 7081 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.571412 7103 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:03.569382 7100 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.588531 7082 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.727991 7098 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.730571 7104 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.687568 7122 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.730274 7098 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.752027 7124 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.752506 7132 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.752696 7124 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:03.753072 7132 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.755544 7132 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.761709 7081 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.696768 7102 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.764643 7100 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.594751 7092 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:03.703346 7091 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:03.623190 6954 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.735769 7084 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.765793 7123 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.696980 7115 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.766255 7096 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.584142 7085 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.765913 7104 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.658593 7094 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:03.624542 7111 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:03.687278 7108 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.622714 7083 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.892928 6954 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:03.863852 7082 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.887701 7097 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.588073 7106 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.902578 7082 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.803828 7132 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.907603 7098 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.901196 7083 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.839576 7116 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.623358 7120 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:03.897079 7084 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:03.900362 7079 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:03.915817 7082 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.907604 7132 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.792372 7087 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.839543 7095 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.826390 7121 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.772033 7114 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.925835 7096 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.757985 7122 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.943770 6954 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.962112 6954 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.908957 7091 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260807 13:33:03.946950 7084 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:03.963063 7105 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.963564 7105 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.964401 6954 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:03.927654 7129 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:03.952574 7119 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.965229 7129 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.965902 7119 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.945981 7124 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:03.967870 7124 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:03.968641 7124 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:03.969390 7000 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:03.972774 7124 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:03.973627 7124 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:03.974305 7124 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:03.960405 7114 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.904456 7108 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.976557 7124 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.901878 7123 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.952852 7083 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:03.960212 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 646) took 1799 ms. Trace:
I20260807 13:33:03.917112 7115 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.006850 5545 rpcz_store.cc:276] 0807 13:33:02.161087 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:02.161217 (+ 130us) service_pool.cc:227] Handling call
0807 13:33:03.959374 (+1798157us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000ffad4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:03.960108 (+ 734us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2895227776}
I20260807 13:33:03.908515 7116 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:03.905366 7102 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.009871 7111 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:03.916906 7097 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:03.978523 7092 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.007196 7103 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.036044 7105 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.010854 7085 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.052739 7122 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.052850 7104 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.002305 7124 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.057950 7132 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.058391 7114 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.059902 7094 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:04.063778 7124 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.047631 7103 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.053637 7122 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.054149 7087 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.060940 7098 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.038093 7092 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.074548 7084 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.073284 7081 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.077440 7081 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.081389 7123 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.082029 7123 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.082711 7123 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:04.066741 7085 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.069620 7082 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.073529 7122 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.068410 7097 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.071820 7100 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.069926 7119 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.071218 7132 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.063308 7108 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.003289 7121 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:04.111536 5499 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.551s user 0.018s sys 0.024s
I20260807 13:33:04.102977 7120 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:04.124138 5499 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.564s user 0.018s sys 0.024s
I20260807 13:33:04.103513 7081 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:04.073933 7103 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.113165 7129 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.108448 7098 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.077244 7084 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.128182 6694 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 LEARNER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:04.132162 6954 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.140618 7127 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:04.140933 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 354758us
I20260807 13:33:04.142169 7072 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.145673 7121 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.112004 7085 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.114137 7082 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.076153 7087 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:04.119995 7097 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.159462 7102 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.169068 7135 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.170145 7114 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.186941 7128 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.187249 7114 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.188186 7092 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.172401 6954 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.120438 7100 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.180245 7093 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.148888 7105 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.183171 7115 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.154573 7096 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.133147 7132 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.171914 7124 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.148995 7123 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.187908 7128 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.194905 5764 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:04.150800 7147 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.221036 7070 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.199651 7093 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.205057 7105 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.206362 7120 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.171926 7079 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.153703 7106 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.194612 7097 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.218473 7092 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.219242 7141 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.238991 7096 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:04.246043 5616 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.593s user 0.006s sys 0.040s
I20260807 13:33:04.245764 7079 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.230003 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.220640 7147 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.210985 7111 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.259860 6954 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.262485 7142 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.290882 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:04.196488 7127 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.243486 7144 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.253572 7070 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.302790 7096 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.215131 7135 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.308048 6694 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:04.247081 7120 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.332089 7084 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:04.308573 7091 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.333371 7120 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.333217 7091 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.309087 7133 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.290395 7093 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.309707 7000 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.310433 7121 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.249691 7105 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.335165 7133 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.248608 7097 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.265568 7115 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.326835 5661 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:04.326997 7127 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.290758 7122 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.345901 7096 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.328187 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.390803 5665 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:04.336503 5545 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.306209 7141 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.337491 5503 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:04.328486 7116 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.316529 7106 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.380906 7070 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.370968 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:04.377099 7121 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:04.312213 5616 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.788s user 0.016s sys 0.053s
I20260807 13:33:04.297902 7092 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.312310 7111 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:04.398639 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 61236.5us
I20260807 13:33:04.210345 7072 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.408907 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.411761 7076 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.412127 5665 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.334430 7144 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.410732 7096 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.416622 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.393502 7103 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.399587 7114 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.406139 7104 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:04.413362 7111 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.423130 7079 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.404036 7098 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.435252 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.407147 7106 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.429464 7093 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.434582 7096 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.441010 7093 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.443527 7096 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.444729 7093 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:04.445828 7121 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.407657 7122 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.387974 7000 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.412719 7076 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.420094 7147 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.426241 7132 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.425231 7097 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.434970 7100 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.429394 7127 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.401647 7115 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.457394 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.457764 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.454784 5667 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.435560 7104 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.460358 5548 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
W20260807 13:33:04.448448 6731 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0960 after lost signal to thread 3828
I20260807 13:33:04.457809 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.462025 7091 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.452934 7079 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.469209 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.463761 7127 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:04.328860 7142 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.454276 7122 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.469537 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.571956 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.555495 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.588229 5548 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.568912 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.464052 7104 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:04.567175 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.503104 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:04.578176 7148 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.462554 7130 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.598658 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.592487 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.601838 5661 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.609724 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.607668 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.464337 7120 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.465822 7092 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.479112 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.611546 5659 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
I20260807 13:33:04.468957 7100 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.475119 7121 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.616483 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.623842 5659 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
I20260807 13:33:04.463835 7097 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.478607 7000 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.617005 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:04.580094 7144 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.574712 7135 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.477802 7141 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.479944 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.479736 7128 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.642100 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.528443 7072 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.492452 7079 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.634194 6636 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:04.635499 7097 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:04.625983 6731 debug-util.cc:398] Leaking SignalData structure 0x7b080022bda0 after lost signal to thread 5446
I20260807 13:33:04.609156 7133 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.479053 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.554190 7076 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.646593 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.625413 7122 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.651839 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.652428 5659 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:04.620318 5553 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.653045 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.653131 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.622434 7153 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:04.628170 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.645920 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.629588 7106 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.556833 7150 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:04.618160 7120 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.651392 6636 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:04.667507 7142 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.674356 7142 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.626245 7100 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.676012 5762 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
W20260807 13:33:04.659176 6731 debug-util.cc:398] Leaking SignalData structure 0x7b0800172e20 after lost signal to thread 5594
I20260807 13:33:04.655143 7135 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:04.684525 7135 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.681619 7147 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:04.685369 7135 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:04.675076 7142 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.650295 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:04.685556 7147 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.654831 7115 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.689898 7142 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.689769 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.646270 7121 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.680943 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:04.479342 7136 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.319s
I20260807 13:33:04.706225 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.692822 7147 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:04.703341 5555 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.710546 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.713333 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.715626 7127 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.717185 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.719488 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.721568 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.725659 5548 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:04.654567 7153 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.744757 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.746459 5661 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:04.747113 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.627463 7148 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.649201 7130 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:04.708776 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:04.704334 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.752660 7120 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.755752 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.726250 7082 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.759838 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.786469 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.788189 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.761143 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.785039 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.788703 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.748980 7085 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:04.794545 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 63007.8us
I20260807 13:33:04.675830 7150 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:04.799301 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.797887 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.751852 7142 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:04.803680 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.832981 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.834937 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.837119 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.840044 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.840729 5767 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:04.840978 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.841802 7087 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:04.843071 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.844036 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.844571 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.829344 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.845135 5544 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.845389 5543 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.847892 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.805470 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:04.796439 6731 debug-util.cc:398] Leaking SignalData structure 0x7b080015afc0 after lost signal to thread 5702
I20260807 13:33:04.850626 7148 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.829783 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.809482 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.785094 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.859284 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.801085 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.820353 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.808658 5542 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.807924 5763 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:04.822901 7079 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.826897 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.847362 7153 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.859930 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.927964 7100 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:04.928546 5665 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:04.924679 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.930352 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.930379 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.930737 5543 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.931155 5545 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.931226 5659 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:04.884977 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.808166 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:04.933126 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.939874 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.862178 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.941694 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.943235 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.947643 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.948401 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.948625 5544 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.950585 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.950841 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.959995 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.963850 7121 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.965826 7130 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:04.968891 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.969213 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.973692 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.980193 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.987457 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.988149 5659 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.993741 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.989843 6696 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:33:04.861275 7142 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.000325 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.001430 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:04.945288 7135 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:04.998189 6731 debug-util.cc:398] Leaking SignalData structure 0x7b080017d7e0 after lost signal to thread 5805
I20260807 13:33:04.971987 5556 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:04.986860 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:04.985520 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:05.011077 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.025702 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:04.995977 7104 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.031092 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.025698 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.036233 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.029443 5766 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
I20260807 13:33:05.038600 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.028302 7150 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:05.020607 7147 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.042146 5552 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.044098 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.045894 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.049616 6638 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:05.037457 6731 debug-util.cc:398] Leaking SignalData structure 0x7b08003152e0 after lost signal to thread 6738
I20260807 13:33:05.051211 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.021112 5656 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
I20260807 13:33:05.055389 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.020509 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.062704 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.063160 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.066475 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.066639 7135 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.067317 7135 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.063834 6692 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:05.071455 7142 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:05.071513 7104 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:05.075505 7147 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.075925 6687 raft_consensus.cc:1226] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.120200 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.122511 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.123360 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.123620 5552 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:05.124238 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.125480 5555 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:05.126276 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.127311 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.128189 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.125478 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.130802 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.132346 5544 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 13:33:05.132511 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.135090 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.137557 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.139997 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.140914 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.141549 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.143184 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.144730 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.149405 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.153599 5499 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:05.159750 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.168378 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.169451 5658 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:05.170641 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.170759 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.171933 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.172803 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.173269 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.175168 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.175314 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.176927 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.177068 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:05.177074 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.179180 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:05.191711 5722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.527s (SENT) [suppressed 4 similar messages]
I20260807 13:33:05.197115 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.198594 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.199544 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.200007 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.201428 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.202327 5764 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:05.203584 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.204479 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.204779 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.206084 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.208990 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.213541 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.201701 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.206658 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.220971 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.222529 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.223567 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.224037 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.225214 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.227116 7104 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.227568 7104 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:05.210035 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.228076 7104 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.230437 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.237003 5762 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:05.239737 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.239701 7092 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260807 13:33:05.243788 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.247722 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:05.247946 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 247693us
I20260807 13:33:05.248631 5762 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:05.249854 6638 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:05.257437 7164 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.257910 7164 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.256778 5499 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:05.257745 6638 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:05.258416 7164 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.259763 7147 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.260293 7147 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.260357 7072 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.260710 7147 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.260749 7072 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:05.261272 7072 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.266475 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.258440 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.258077 5722 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.268441 5771 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:05.268472 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.259464 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.269845 5762 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:05.270488 7085 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:05.279131 7085 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.279369 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.279727 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:05.280794 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.279712 7085 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:05.281697 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.290688 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:05.279726 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.294994 7000 consensus_queue.cc:1046] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:05.296428 7000 raft_consensus.cc:3032] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.293917 7136 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260807 13:33:05.297824 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:05.298523 5722 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.273973 7164 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.258846 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.276895 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.276429 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.277654 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.299490 7000 raft_consensus.cc:729] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:05.301801 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.276361 7147 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.303896 7087 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.305790 7087 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.306806 7087 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.306741 5767 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:05.307366 5499 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:05.307974 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.308288 7108 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.308730 7108 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:05.309128 7108 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.309593 6693 raft_consensus.cc:1226] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.313436 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.317255 6692 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.317519 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.313493 7104 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.324595 7104 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.325670 7000 consensus_queue.cc:260] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.326297 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.327256 7000 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.328320 7076 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:05.329025 6692 raft_consensus.cc:1226] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: [1.4-1.4]
I20260807 13:33:05.330870 7142 consensus_queue.cc:1046] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:05.332464 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.332639 7142 raft_consensus.cc:3032] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.333212 7142 raft_consensus.cc:729] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:05.333505 5556 raft_consensus.cc:2379] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 2: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:05.335163 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.335341 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.335276 7142 consensus_queue.cc:260] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.336519 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.337663 7142 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.337951 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.338992 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.308982 7072 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.339875 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.341213 7092 consensus_queue.cc:1046] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260807 13:33:05.343570 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.344112 7076 consensus_queue.cc:1046] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:05.344573 6637 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.345266 7114 raft_consensus.cc:3032] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.345696 7114 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:05.346714 7135 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.346863 7114 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.348798 7114 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.340214 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.351796 6637 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.353948 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.354442 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.356487 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.356959 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.357319 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.356562 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.356666 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.359754 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.362260 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.362494 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.362748 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.360674 7135 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.363328 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.360692 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.363941 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.364575 7135 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.365955 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.366724 7092 raft_consensus.cc:3032] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.367072 7092 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:05.367435 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.368124 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.367944 7092 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.368829 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.368929 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.369187 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.369448 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.368830 5663 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.370288 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.370611 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.368980 7092 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.371845 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.374553 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.378760 7085 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.380236 5552 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:05.358310 7108 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.382226 7108 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.358430 7087 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.385545 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.386693 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.387432 7087 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.387997 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.388428 7147 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.389991 7085 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.390311 7164 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.391323 5761 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:33:05.392400 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.396775 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.397867 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.400842 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.392033 5663 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:05.410243 7072 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.412919 5499 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:05.414147 5499 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:05.415661 7000 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.416059 5661 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:05.422266 7000 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:05.422854 7000 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.416263 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.418407 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.418713 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.424053 6636 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:05.425179 7150 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.434769 7150 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:05.435297 7150 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.439935 7166 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:05.440567 7166 raft_consensus.cc:686] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:05.442323 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.441804 7166 consensus_queue.cc:237] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:05.444130 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 63023.8us
I20260807 13:33:05.445050 5722 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.448133 5721 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.449111 7087 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.449481 7087 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.449908 7087 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.450636 7100 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.451063 7100 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.451431 7100 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.457058 7087 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.459484 5721 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.461419 7085 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.461653 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.461961 7085 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.462352 5552 raft_consensus.cc:1799] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Handling vote request from an unknown peer 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:05.462487 7085 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.463023 5552 raft_consensus.cc:2396] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260807 13:33:05.449695 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 98036.8us
I20260807 13:33:05.464301 6637 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.465386 7164 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.466303 6637 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.477586 7164 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.478045 6637 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.459517 7100 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.479781 7164 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.470455 7150 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.470055 7085 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.481200 7100 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.472589 7087 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.484948 7085 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.485316 5722 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.486456 7170 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.487329 7170 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.487717 7170 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.499737 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.500586 5552 raft_consensus.cc:2396] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260807 13:33:05.505878 7079 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:05.475304 7000 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.507647 5722 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.512686 5721 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.510658 6637 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.518599 7166 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.519392 5722 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.524973 7087 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.525540 7150 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.535553 7167 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:05.537360 7167 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.537714 7000 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.538210 7167 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:05.537353 7085 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.538806 7170 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.539160 7085 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.544386 7085 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.553385 5721 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.561271 5620 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.543087 5390 catalog_manager.cc:5495] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 1 to 2, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 2 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:33:05.563046 7176 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.563577 7176 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.564035 7176 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.563050 5620 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.546170 7170 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.569341 7142 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:33:05.570976 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 57087.5us
I20260807 13:33:05.572887 7173 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.574002 7173 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.575021 7173 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.573953 5722 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.576752 5722 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.576128 5618 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.578472 7178 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.579743 7179 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.580230 7179 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.580749 7179 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.581482 5620 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.582692 7178 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.584002 7178 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.584288 7182 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.584419 7178 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.584738 7182 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.585166 7182 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.585546 5722 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.587697 5620 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.588936 7079 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.589309 7079 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.589942 7079 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.592131 7100 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.592808 7100 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.593681 7100 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.595122 5722 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.596985 7170 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.597383 7170 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.597491 5620 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.597779 7170 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.600477 5722 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.601750 7087 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.600433 7079 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.601930 7167 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.604025 7167 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.603940 7100 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.604750 7170 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.605587 7100 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.605883 7079 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.607205 7170 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.607127 5722 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.609561 7079 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.609907 7079 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.610325 7079 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.611809 5721 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.616338 5618 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.617740 5618 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.617830 7085 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.617631 7174 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:05.620204 5721 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.621378 7100 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.621816 7100 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.622524 7100 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.620519 5618 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.625346 7087 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.628717 7173 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.630647 7173 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.631104 7079 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.615567 7170 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.636149 7173 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:05.636581 5722 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.637449 7087 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.637537 7167 raft_consensus.cc:3032] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.637866 7087 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.637895 7167 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:05.638540 7087 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.639092 7167 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.640396 7167 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.647313 5721 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.645478 7087 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:05.654452 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 45229.2us
I20260807 13:33:05.655467 5620 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.657336 7170 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.659332 5721 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.661334 5721 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.662132 7197 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.662482 5721 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.662981 7197 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.663470 7170 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.615197 7178 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.665025 7189 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.665851 7189 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.666304 7192 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.667804 7189 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.668282 7189 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.668812 7189 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.668339 7178 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.668363 7176 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.668876 5721 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.671208 7176 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.671363 5721 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.674535 7167 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.647815 7085 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.679100 5620 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.688297 7142 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.688674 7142 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.689677 7142 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.692619 7087 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:05.635177 7100 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.693765 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:05.694442 7100 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.695076 5722 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.672145 7170 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.697795 5722 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.704808 5620 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.708354 7170 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.708036 7179 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.703991 7100 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.710137 7199 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:05.710146 7100 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:05.711237 7100 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.711349 7182 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.713544 7182 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.711294 7199 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.715682 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.718076 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:05.718855 7100 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.720965 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.721526 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.721590 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.721606 7100 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.723127 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.732087 7194 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.732225 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.732649 7194 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.733057 7194 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.733186 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:05.737217 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 116788us
I20260807 13:33:05.733523 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.739306 5620 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:05.739831 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.740249 5554 raft_consensus.cc:1226] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.733081 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.741245 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.737937 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.743376 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.740790 5722 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.741562 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.738042 5553 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.730242 7192 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:05.741570 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.742726 5721 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.743515 5618 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.709776 7176 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:05.749155 7176 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.749629 5721 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.750743 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.751160 7176 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.751312 7087 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.750768 7170 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.752285 5620 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.752092 7192 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.752619 7170 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.753036 7170 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.753584 5722 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.751387 5544 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.756039 7085 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.756642 7085 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.758435 7192 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.758490 7199 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.759122 7079 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.760784 7176 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.762085 7170 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.767561 7192 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.768106 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.760686 5721 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.762849 5618 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.764915 7087 consensus_queue.cc:1046] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:05.769946 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.771843 7194 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.773103 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.773691 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.776821 5767 raft_consensus.cc:1226] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.776901 5662 raft_consensus.cc:1226] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.777333 5762 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.777259 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.776907 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.778523 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.768671 7179 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.778831 7194 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.776932 5769 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.779376 7194 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.776003 7150 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.780565 5769 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.781865 5762 raft_consensus.cc:1226] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.782160 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.781740 5618 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.782907 5765 raft_consensus.cc:1226] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.783566 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.783771 7192 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.782884 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.785132 7087 raft_consensus.cc:3032] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.785575 5721 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.785648 7087 raft_consensus.cc:729] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:05.786437 7197 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.786827 7087 consensus_queue.cc:260] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.787573 7197 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.787788 5721 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.788241 7087 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.789000 5721 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.789306 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.787310 5544 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:05.791672 7085 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.792030 7085 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.792388 7085 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.792783 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.795490 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.796725 7170 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:05.797736 7170 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.798712 5667 raft_consensus.cc:1226] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.791343 5618 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.803346 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.774511 7201 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:05.802213 7179 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260807 13:33:05.809923 7085 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.807821 7194 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.806030 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.810776 5721 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.810258 7201 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:05.811254 7173 raft_consensus.cc:3032] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.811496 7201 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.806324 6692 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:05.811676 7173 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:05.808862 5618 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.813279 7100 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.813519 7173 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.818406 7192 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.818462 7194 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:05.820116 7173 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.819326 7194 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.822296 7194 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.823689 5618 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.824430 7194 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.825395 5618 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.825876 5665 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 13:33:05.826066 7194 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.826930 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.817447 5721 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.827776 7085 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:05.827500 7166 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:05.829818 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:05.830256 5544 raft_consensus.cc:1226] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.831048 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:05.833139 5665 raft_consensus.cc:1226] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.827610 7194 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.805557 7189 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.835631 5667 raft_consensus.cc:1226] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.836225 7189 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.840159 5618 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.841305 5722 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:05.841619 5721 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.815286 7142 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.846621 5618 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.843886 7189 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.850862 5666 raft_consensus.cc:1226] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.847671 7085 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.845963 7167 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.851269 7174 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.851992 5618 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.861919 5618 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.862715 7194 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.863350 7194 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.864023 5618 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.864854 5556 raft_consensus.cc:1226] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.865113 5618 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.866001 7192 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.866044 7194 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.867405 5721 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.868667 7173 raft_consensus.cc:2726] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.869149 5618 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.870222 5618 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.870375 5721 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.852553 7142 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.844276 7170 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.850914 5663 raft_consensus.cc:1226] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.856247 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.871285 7174 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.871249 7167 consensus_queue.cc:1046] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:05.856905 7150 consensus_queue.cc:1046] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:05.871712 5721 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.844758 7179 consensus_queue.cc:1046] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260807 13:33:05.873123 5618 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:05.873972 7170 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.874428 5556 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.874608 7194 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.875957 5769 raft_consensus.cc:1226] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.881389 5501 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.874604 7085 raft_consensus.cc:3032] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.881980 7085 raft_consensus.cc:729] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:05.882700 7150 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.883065 5769 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.882872 7085 consensus_queue.cc:260] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.876745 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:05.874742 7076 raft_consensus.cc:3032] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.886300 5501 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.886550 7076 raft_consensus.cc:729] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:05.887636 7150 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.887480 7076 consensus_queue.cc:260] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.888562 7076 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.876757 7167 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.877395 7182 raft_consensus.cc:3032] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.877667 7170 consensus_queue.cc:1046] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:05.877995 7092 consensus_queue.cc:1046] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:05.878882 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.879789 7108 consensus_queue.cc:1046] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:05.862490 7201 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:05.904665 7142 consensus_queue.cc:1046] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:05.905553 5661 raft_consensus.cc:1226] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260807 13:33:05.906178 7176 raft_consensus.cc:3032] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.906548 7176 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:05.907402 7176 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.908320 7176 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.909364 7201 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:05.912693 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.914817 5764 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:05.886261 7085 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.892246 7192 consensus_queue.cc:1046] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:05.892935 7150 raft_consensus.cc:3032] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.893373 7194 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.893509 7072 raft_consensus.cc:3032] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.889804 7182 raft_consensus.cc:729] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:05.895577 7167 raft_consensus.cc:3032] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.897030 7174 consensus_queue.cc:1046] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:05.890746 7189 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.898715 5501 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.901896 5769 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 13:33:05.889000 5390 catalog_manager.cc:5495] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:05.917388 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:05.921592 7150 raft_consensus.cc:729] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:05.929864 7150 consensus_queue.cc:260] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.930991 7150 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.931087 7072 raft_consensus.cc:729] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:05.931942 7072 consensus_queue.cc:260] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.933041 7072 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.934322 7167 raft_consensus.cc:729] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:05.935127 5770 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:05.936568 5501 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.936838 7076 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.937681 7076 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:05.928663 7192 raft_consensus.cc:3032] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.939110 7192 raft_consensus.cc:729] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:05.938721 7182 consensus_queue.cc:260] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.939934 7182 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.939903 7192 consensus_queue.cc:260] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.941355 7192 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.942493 7174 raft_consensus.cc:3032] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.942934 7174 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:05.943953 7174 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:05.946375 7201 consensus_queue.cc:1046] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:05.935225 7167 consensus_queue.cc:260] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.947768 7164 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:05.949075 5501 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.949265 7167 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.950146 5501 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.951200 5501 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.951819 7092 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.952283 7108 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.950224 7114 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.945637 7174 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.961549 7142 consensus_queue.cc:1046] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:05.962347 7201 raft_consensus.cc:3032] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.962628 7142 raft_consensus.cc:3032] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:05.962975 7142 raft_consensus.cc:729] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:05.963765 7142 consensus_queue.cc:260] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.964623 5501 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.964592 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.962663 7201 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:05.968600 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.968686 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.969131 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.969154 7201 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:05.969877 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.970436 7201 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.970567 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.970980 7000 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.972481 5501 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.973188 7000 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.974298 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.975360 7142 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:05.976518 5501 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.976451 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.977382 7000 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.978274 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.979200 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.979368 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.979642 5501 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.979694 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.979240 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.981130 5501 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.981406 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.980374 7000 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.982569 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.982905 7076 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.982649 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.983428 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.985154 5501 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.985533 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:05.986584 5658 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:05.986928 7072 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.987874 5501 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.989529 7072 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.990679 5501 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.992678 7072 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.993853 5501 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.995903 7072 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:05.997666 5721 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:05.998179 5501 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:05.998704 7182 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.000391 7072 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.000766 5721 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.001452 5501 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:06.001775 7182 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.002586 5721 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.003961 5721 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.007790 5721 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.009208 5721 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.014365 7087 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.014920 7072 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.015781 7100 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:06.011018 5721 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.016285 7179 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.016121 7174 consensus_queue.cc:1046] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.016886 7173 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.017297 7174 raft_consensus.cc:3032] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.019096 5501 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:06.018374 5665 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:06.019665 7174 raft_consensus.cc:729] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.019949 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:06.020629 7174 consensus_queue.cc:260] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.021800 7174 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.022087 7000 consensus_queue.cc:1046] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.023037 7000 raft_consensus.cc:3032] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.023337 7000 raft_consensus.cc:729] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:06.020653 5770 raft_consensus.cc:1226] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:06.024937 5721 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.027161 5765 raft_consensus.cc:1226] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:06.028007 5665 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:06.022898 7076 consensus_queue.cc:1046] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.029186 5770 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:06.029343 7100 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.030042 7179 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:06.027195 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:06.028753 5721 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.017899 7194 consensus_queue.cc:1046] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260807 13:33:06.033154 7100 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.033003 7176 consensus_queue.cc:1046] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:06.033699 7194 raft_consensus.cc:3032] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.034164 7176 raft_consensus.cc:3032] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:06.034556 7176 raft_consensus.cc:729] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.034631 7000 consensus_queue.cc:260] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.035352 7176 consensus_queue.cc:260] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.034082 7194 raft_consensus.cc:729] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.036708 5721 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.035877 7000 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.037834 7194 consensus_queue.cc:260] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.038163 7196 consensus_queue.cc:1046] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.039186 7194 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.039237 7079 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.040220 7201 raft_consensus.cc:3032] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.040548 7201 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.041546 7076 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.042093 7076 raft_consensus.cc:3032] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.042420 7076 raft_consensus.cc:729] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:06.042656 7176 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:06.043334 7170 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.043166 7076 consensus_queue.cc:260] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.044435 7076 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.045258 5721 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.045889 7189 raft_consensus.cc:3032] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.046087 7170 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.046356 7189 raft_consensus.cc:729] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.047241 7072 consensus_queue.cc:1046] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.047138 7189 consensus_queue.cc:260] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.048228 7189 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.048436 7108 consensus_queue.cc:1046] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.049437 7108 raft_consensus.cc:3032] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.049736 7108 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:06.048197 7072 consensus_queue.cc:1046] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 13:33:06.050532 7108 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.051056 7072 raft_consensus.cc:3032] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.051412 7072 raft_consensus.cc:729] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:06.051823 7108 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.048175 5721 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.048449 7000 raft_consensus.cc:3032] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.054493 7000 raft_consensus.cc:729] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:06.056572 7000 consensus_queue.cc:260] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.057753 7000 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.055085 7170 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.068361 5721 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:06.069278 7167 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.069841 7167 raft_consensus.cc:686] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:06.045934 5667 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
W20260807 13:33:06.074894 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 55792.2us
I20260807 13:33:06.075659 5501 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:06.075973 5662 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:06.027508 5660 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:06.078696 5721 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.079577 7000 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:06.080502 5501 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:06.081702 5501 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:06.082425 7000 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.082938 7000 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.084229 5501 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:06.084962 7092 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.082880 5721 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.087046 5501 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:06.088068 5501 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:06.085892 7167 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:06.090907 7150 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.091498 7085 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.092006 7085 raft_consensus.cc:686] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:06.092935 7085 consensus_queue.cc:237] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.094352 7170 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.094938 7170 raft_consensus.cc:686] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:06.095886 7170 consensus_queue.cc:237] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.052183 7072 consensus_queue.cc:260] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:06.104046 7000 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.105126 5501 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:06.108588 7150 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.076967 7201 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.118315 5721 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.123071 5659 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:06.129629 7100 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.130184 7100 raft_consensus.cc:686] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:06.130422 7201 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.131080 7100 consensus_queue.cc:237] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.135505 7072 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.144718 5501 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:06.146296 7150 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.147917 7114 consensus_queue.cc:1046] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 13:33:06.151022 7114 raft_consensus.cc:3032] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.151465 7114 raft_consensus.cc:729] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:06.152379 7114 consensus_queue.cc:260] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.153636 7114 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.154811 5762 raft_consensus.cc:1226] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:06.153528 5769 raft_consensus.cc:1226] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:06.157248 5762 raft_consensus.cc:1226] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:06.160202 7201 consensus_queue.cc:1046] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.161751 7174 consensus_queue.cc:1046] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:06.162990 7174 consensus_queue.cc:1046] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.164175 7174 raft_consensus.cc:3032] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:06.164608 7174 raft_consensus.cc:729] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.166288 7192 raft_consensus.cc:3032] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.166754 7192 raft_consensus.cc:729] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.167773 7192 consensus_queue.cc:260] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.169384 7192 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.170640 5721 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:06.171741 7085 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.165637 7174 consensus_queue.cc:260] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.172535 7085 raft_consensus.cc:686] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:06.172734 7174 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:06.174211 7085 consensus_queue.cc:237] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.183671 7194 raft_consensus.cc:3032] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.184056 7194 raft_consensus.cc:729] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.184842 7194 consensus_queue.cc:260] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.185917 7194 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.220579 5390 catalog_manager.cc:5495] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 2, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 2 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:33:06.227035 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 79704.2us
I20260807 13:33:06.227748 5501 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:06.229708 7076 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.231276 5390 catalog_manager.cc:5495] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 reported cstate change: config changed from index 3 to 2, term changed from 1 to 2, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193), VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194), VOTER 737c581af06a42df94970a1542600159 (127.3.187.195), VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 2 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:06.232792 7076 raft_consensus.cc:686] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:06.234042 7076 consensus_queue.cc:237] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.233917 5390 catalog_manager.cc:5495] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 2, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 2 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:06.249948 5390 catalog_manager.cc:5495] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 2, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 2 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:06.250785 5553 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260807 13:33:06.250674 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:06.261168 5552 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:06.265830 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:06.252372 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:06.273275 5556 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:06.253062 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:06.276028 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:06.251272 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:06.274315 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:06.281411 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:06.282552 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:06.263300 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:06.283540 5543 raft_consensus.cc:2396] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260807 13:33:06.251410 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:06.261965 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:06.295822 5544 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:06.296628 5545 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:06.308209 5556 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:06.299930 5390 catalog_manager.cc:5495] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 1 to 2, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 2 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:06.289775 5552 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:06.297704 5391 catalog_manager.cc:5495] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 2, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 2 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:06.302812 5548 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:06.317838 5769 raft_consensus.cc:1226] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:06.335222 5618 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:06.336026 7194 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.336585 5618 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:06.337519 7174 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.336597 7194 raft_consensus.cc:686] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.338789 5618 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:06.339345 7194 consensus_queue.cc:237] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.342660 5618 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:06.343559 7201 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.344647 7201 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.347831 5618 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:06.350696 7201 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.353018 5618 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:06.356103 7201 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.338016 7174 raft_consensus.cc:686] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.357731 7174 consensus_queue.cc:237] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.363663 5618 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:06.380218 7201 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:06.382025 5618 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:06.382978 5618 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:06.383818 5618 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:06.385277 7142 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.386096 7142 raft_consensus.cc:686] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.387367 7142 consensus_queue.cc:237] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.389564 7189 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.389619 5618 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:06.390223 7189 raft_consensus.cc:686] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.390784 7196 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.391637 7196 raft_consensus.cc:686] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.391280 7189 consensus_queue.cc:237] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.392057 7216 consensus_queue.cc:1046] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:06.393858 7108 raft_consensus.cc:3032] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:06.394307 7108 raft_consensus.cc:729] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:06.393437 7196 consensus_queue.cc:237] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.388496 7192 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.395780 7192 raft_consensus.cc:686] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.395378 7108 consensus_queue.cc:260] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.405357 7108 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.397449 7192 consensus_queue.cc:237] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.420825 5618 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:06.421538 7201 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:06.422286 7201 raft_consensus.cc:686] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:06.423887 7201 consensus_queue.cc:237] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:06.448190 5391 catalog_manager.cc:5495] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:06.500960 5391 catalog_manager.cc:5495] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:06.503077 5391 catalog_manager.cc:5495] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:06.504930 5391 catalog_manager.cc:5495] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:06.506721 5391 catalog_manager.cc:5495] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:06.508612 5391 catalog_manager.cc:5495] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:06.512904 5391 catalog_manager.cc:5495] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:06.516399 5552 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.522081 5548 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.533295 5548 raft_consensus.cc:1261] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.535601 7100 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.541738 5552 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.543457 6692 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.543123 7179 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:06.575120 6692 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 13:33:06.577643 7179 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:06.590562 5391 catalog_manager.cc:5495] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193), VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194), VOTER 737c581af06a42df94970a1542600159 (127.3.187.195), VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 2 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:06.601814 5544 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.607286 5661 raft_consensus.cc:1261] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.608976 7179 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.618695 5659 raft_consensus.cc:1261] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.620105 7179 consensus_queue.cc:1035] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.621642 5544 raft_consensus.cc:1261] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.628958 7085 consensus_queue.cc:1035] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.637657 5660 raft_consensus.cc:1261] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.637764 5662 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.639460 7100 consensus_queue.cc:1035] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:06.642234 7085 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:06.724596 5553 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 13:33:06.739666 5660 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 13:33:06.757133 7085 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260807 13:33:06.765141 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 52732.5us
I20260807 13:33:06.773552 7167 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 13:33:06.786809 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 45129.2us
I20260807 13:33:06.792279 5548 raft_consensus.cc:1261] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.800477 7142 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:06.807454 5552 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.807902 5660 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.813002 5548 raft_consensus.cc:1261] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.814309 5556 raft_consensus.cc:1261] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.819442 5769 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.831243 5769 raft_consensus.cc:1261] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.836747 7142 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:06.831347 5544 raft_consensus.cc:1261] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.866580 5552 raft_consensus.cc:1261] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.872977 5660 raft_consensus.cc:1261] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.879534 5762 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:06.879776 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 48014.3us
I20260807 13:33:06.882771 5764 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:06.897054 5770 raft_consensus.cc:1261] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.909385 5764 raft_consensus.cc:1261] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.917389 5762 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.910526 7201 consensus_queue.cc:1035] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260807 13:33:06.922202 7192 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:06.919365 7142 consensus_queue.cc:1035] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260807 13:33:06.942178 5770 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:06.957441 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 144204us
I20260807 13:33:06.965549 5556 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.968818 5770 raft_consensus.cc:1261] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.976033 5767 raft_consensus.cc:1261] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:06.970623 7100 consensus_queue.cc:1035] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 13:33:06.960309 7201 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260807 13:33:06.960474 7142 consensus_queue.cc:1035] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260807 13:33:06.970391 7192 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260807 13:33:07.002272 7196 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:06.990401 7108 consensus_queue.cc:1035] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 13:33:06.990451 7174 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 13:33:07.034093 5542 raft_consensus.cc:1261] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:07.047034 7164 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.047672 7164 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.061517 7164 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.063413 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.064227 5542 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:07.065925 6637 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:07.067239 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 82224.6us
I20260807 13:33:07.067493 7261 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.069211 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:07.068363 7261 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.069795 5662 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
I20260807 13:33:07.074155 7261 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.074221 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.075428 5544 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:07.077075 5722 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.078351 5769 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:07.078529 7261 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.079886 7261 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.080396 7261 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.089332 7164 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.090261 7164 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.091712 7164 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.131110 5769 raft_consensus.cc:1261] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:07.132332 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:07.139168 7201 consensus_queue.cc:1035] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260807 13:33:07.158628 7275 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 13:33:07.180544 5544 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:07.254362 5769 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:07.272356 7275 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 13:33:07.274216 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 444283us
I20260807 13:33:07.277908 7100 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:07.248483 7174 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:07.292845 7114 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.291445 7288 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:07.308701 7280 log.cc:924] Time spent T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.073s user 0.002s sys 0.000s
I20260807 13:33:07.311172 7261 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.308729 7267 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.287653 7174 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.313517 7267 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.314883 7293 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.315577 7293 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.317199 7267 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.318022 7267 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.319639 7267 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.318390 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.324949 5770 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:07.326351 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.330346 7275 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:07.330462 7267 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:07.330770 7275 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:07.331197 7275 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:07.357988 7255 log.cc:924] Time spent T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.319s user 0.000s sys 0.005s
I20260807 13:33:07.317940 7174 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.375360 7266 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.318295 7288 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:07.353134 7291 log.cc:924] Time spent T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260807 13:33:07.383245 7261 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.383097 7266 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.386263 7252 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.387085 7252 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.323172 7114 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.393455 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.403221 5770 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:07.394094 7293 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.396358 7298 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:07.408991 7085 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.409201 7275 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.409492 7085 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.411311 7114 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:07.413048 7085 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.397701 7252 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.416977 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:07.405843 7293 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:07.406378 6638 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:07.415059 7164 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.405248 7266 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:07.436286 7164 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.421494 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:07.437006 5661 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:07.437544 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:07.438143 5662 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:07.434463 7288 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.451853 5721 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.453088 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.453846 5770 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
I20260807 13:33:07.454979 7251 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.455453 7251 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.451529 7164 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.455869 7251 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.456173 7164 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.456655 7164 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.460789 7275 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.465272 5721 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.468647 7289 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.468988 7289 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.469292 7289 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.448182 7293 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.479169 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.479840 5762 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:07.480896 7293 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.503283 7196 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.503875 7196 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:07.506855 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 50997.4us
I20260807 13:33:07.508464 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:07.509747 7251 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.513038 7289 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.515502 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.516106 7289 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.516194 5765 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:07.519313 5620 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.523343 5770 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:07.525357 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:07.526006 5662 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.535106 5662 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:07.536343 5721 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.548094 7307 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.548659 7307 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.553643 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:07.556174 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:07.556850 6691 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:07.557355 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:07.558030 6688 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:07.559845 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:07.560086 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:07.560712 5665 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.564002 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:07.564534 5659 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 3
W20260807 13:33:07.565547 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 269611us
I20260807 13:33:07.520056 7196 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.535179 7251 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.534802 7192 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.562425 7289 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:07.576350 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.582907 5770 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:07.574939 5665 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:07.584438 7278 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:07.587955 7278 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.588282 7298 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.588786 7298 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.590831 7298 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.584565 7192 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.590997 7278 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.593163 7192 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:07.591332 7298 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.591756 5661 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:07.602370 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.603154 5762 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
W20260807 13:33:07.612071 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 92851.9us
I20260807 13:33:07.613554 5659 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:07.614640 5721 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.615051 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.600680 7289 raft_consensus.cc:686] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:07.599907 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:07.604230 7298 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.618511 7306 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:07.618517 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.635129 5544 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:07.634893 7306 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.618606 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.619589 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:07.620272 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:07.638989 5553 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:07.639216 6692 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:07.622601 7307 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:07.613976 6636 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:07.617442 7266 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:07.640754 7266 raft_consensus.cc:686] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:07.624287 5503 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:07.640950 6636 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:07.641649 5503 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:07.624513 5660 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:07.641588 7266 consensus_queue.cc:237] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.628983 7298 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.629441 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:07.634416 7167 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.636253 7289 consensus_queue.cc:237] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.643626 7320 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.655802 7076 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.657614 7076 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.641892 7293 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:07.655984 7320 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.658257 7076 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.658622 7320 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.639303 5556 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.620959 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.628726 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:07.637918 7306 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.661027 5554 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.642354 7307 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.672428 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:07.672806 6636 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:07.676203 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 61327.8us
I20260807 13:33:07.678685 6688 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:07.633879 7164 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.683012 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.684629 5556 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:07.664618 5552 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.687315 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.673703 7307 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.686760 5764 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:07.688468 7307 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.664718 7167 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.690238 7164 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.689913 7174 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.691819 7174 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.692749 6693 raft_consensus.cc:2379] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:07.693418 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.693723 7174 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.694325 5762 raft_consensus.cc:2354] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:07.680531 7323 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:07.695698 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.696038 7323 raft_consensus.cc:686] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:07.696403 5767 raft_consensus.cc:2379] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:07.696969 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.697607 5761 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:07.697319 7323 consensus_queue.cc:237] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.698681 7201 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.699501 7201 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.700930 5553 raft_consensus.cc:2379] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:07.702260 7201 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:07.664486 7293 raft_consensus.cc:686] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:07.694656 7167 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.704583 5620 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.687216 5554 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:07.709170 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.709719 5765 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:07.702874 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:07.711993 7164 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:07.714542 6688 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:07.710825 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:07.716391 5767 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.716285 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:07.717460 5545 raft_consensus.cc:2379] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:07.719115 5621 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:07.725554 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.726362 5545 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:07.723518 7167 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.727882 7174 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.742709 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.739252 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:07.732647 7072 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:07.740808 7319 log.cc:924] Time spent T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.081s user 0.000s sys 0.001s
I20260807 13:33:07.875159 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.875811 5548 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:07.743789 5545 raft_consensus.cc:2354] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:07.732224 7192 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:07.743584 7174 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.746055 7167 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.723764 7307 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.755661 7316 consensus_queue.cc:1035] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260807 13:33:07.742236 5620 leader_election.cc:398] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:07.741214 7293 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.830509 7216 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:07.830677 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.831795 7196 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:07.834394 7296 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.835150 7114 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:07.843679 5767 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:07.848024 7250 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.856757 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.856683 7320 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.859690 7076 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:07.850940 7298 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.862001 7164 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:07.900837 5620 leader_election.cc:401] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:07.892160 7174 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.911677 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:07.892113 7321 log.cc:924] Time spent T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.134s user 0.004s sys 0.004s
I20260807 13:33:07.904335 7275 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.881057 7192 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:07.911337 7246 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:07.917205 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.934525 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:07.935079 5545 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.882298 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.900480 7306 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.923820 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:07.928373 5543 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:07.881692 7072 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.913125 7201 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.935760 5548 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:07.952054 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:07.930979 5544 raft_consensus.cc:1799] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Handling vote request from an unknown peer 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:07.945158 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.927536 7167 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.952747 5548 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.913300 7114 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.938637 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:07.956998 5764 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:07.927878 5660 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:07.934216 7192 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.964452 7114 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.965147 5544 raft_consensus.cc:2379] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:07.916018 7196 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.934365 7142 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.966399 7142 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } }
I20260807 13:33:07.967914 7196 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.968631 7320 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.911701 7296 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.969622 7278 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.954829 7246 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.971873 7296 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.972936 7246 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.911765 7216 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.973657 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:07.973905 5556 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:07.974320 5543 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:07.974875 7216 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.975644 7142 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.976189 5665 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:07.978907 7295 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:07.979748 7307 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:07.979570 7295 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:07.982434 7295 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:07.983265 7326 log.cc:924] Time spent T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.117s user 0.002s sys 0.000s
I20260807 13:33:07.983698 5501 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:07.991096 5545 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:07.931960 6638 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:07.997779 7327 log.cc:924] Time spent T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.094s user 0.000s sys 0.001s
I20260807 13:33:08.019948 7278 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:08.020155 7298 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:07.915642 7250 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.022686 7072 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.023893 7250 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:07.994460 7307 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.024819 7307 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.024950 5552 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:08.025329 7307 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:07.934528 7275 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.027045 7076 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:07.956187 7201 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.008641 5501 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:08.030174 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:08.018916 7192 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:08.030949 5665 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.031399 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.033252 5555 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:08.034067 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.034704 5553 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:08.036731 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.037705 5764 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:08.038347 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.039062 5767 raft_consensus.cc:2379] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:08.039927 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:08.040180 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.040899 5553 raft_consensus.cc:2379] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:08.041159 5769 raft_consensus.cc:2379] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:07.949543 7306 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.043238 7309 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:08.044075 7309 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.045240 7306 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.045403 7201 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.049877 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:08.050458 5767 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.046629 7320 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:08.028851 7275 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.051076 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.056090 5769 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:08.057574 5501 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:08.058404 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 104913us
I20260807 13:33:08.059165 7246 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.057876 5665 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:08.060395 5722 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:08.059741 7246 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:33:08.058909 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 334649us
I20260807 13:33:08.063433 5722 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:08.048132 7076 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.056115 5548 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:08.065794 5620 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:08.048142 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 111842us
W20260807 13:33:08.046446 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 123993us
I20260807 13:33:08.062142 7246 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.068538 7201 raft_consensus.cc:2741] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:33:08.072775 5620 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.064867 7320 raft_consensus.cc:686] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:08.066735 7251 raft_consensus.cc:2741] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:33:08.067736 7076 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.078778 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.079586 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.079846 5548 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:08.075063 5767 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:08.076737 5721 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.078486 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:08.081889 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:08.082322 5769 raft_consensus.cc:2379] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:08.082489 5556 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.080960 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.090026 5556 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:08.091269 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.091586 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.091959 5556 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:08.092621 5501 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.093137 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.093480 5721 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.090531 5542 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:08.093889 5764 raft_consensus.cc:2379] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:08.095228 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.096089 5762 raft_consensus.cc:2396] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260807 13:33:08.080615 7076 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.080736 7201 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.096879 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:08.097607 5553 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:08.100557 5764 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.097980 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.102241 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.121976 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.072270 5544 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:08.122030 7192 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:08.119946 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.140270 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.140997 5767 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:08.100028 7266 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.124171 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.124845 7311 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:08.127838 7340 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.152117 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.152386 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.152745 5665 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:08.120915 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:08.122149 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:08.156978 6693 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.156843 7311 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.157420 6688 raft_consensus.cc:2379] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:08.131651 5659 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:08.093871 7251 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:08.159825 7251 raft_consensus.cc:686] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:08.161487 7309 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.161108 7251 consensus_queue.cc:237] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.136344 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.163708 5769 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:08.150542 7275 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:08.166834 7275 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.137748 5764 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:08.142557 5542 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:08.142829 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.100414 7201 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.154850 7295 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:08.154821 7248 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:08.156498 7340 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.174022 5548 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:08.176226 5661 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:08.185062 5722 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.182969 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.212641 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.102469 7320 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:08.153888 7266 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.234349 7340 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.257808 5665 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
W20260807 13:33:08.281956 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 105476us
I20260807 13:33:08.299307 6638 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:08.304673 7307 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.188687 7201 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.275107 7266 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.313271 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.312862 5618 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
W20260807 13:33:08.320705 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 199269us
I20260807 13:33:08.330488 7293 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:08.346415 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.338737 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:08.274555 7179 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.347651 5665 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:08.257838 7248 raft_consensus.cc:686] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:33:08.260319 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 72357.8us
I20260807 13:33:08.349241 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.387295 5620 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.387724 5662 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:08.278383 7275 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.161067 7174 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.324967 7246 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.361711 5722 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.382717 5618 leader_election.cc:398] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:08.308312 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.314904 7252 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:08.379244 7179 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.393388 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:08.239092 7295 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.392624 7296 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:08.336150 7076 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:08.419315 5661 raft_consensus.cc:2354] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
W20260807 13:33:08.406842 7255 log.cc:924] Time spent T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.052s user 0.000s sys 0.001s
I20260807 13:33:08.391019 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:08.431252 7307 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.402355 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.409652 7337 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.420889 7296 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:08.412572 7179 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.441421 5769 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:08.450012 7076 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:08.454135 7348 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:08.411238 5660 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:08.453599 5618 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:08.433872 6693 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:08.454918 7348 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.463533 7348 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:08.467432 5658 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:08.412098 7252 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.472601 7252 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:08.476531 5618 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:08.477576 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:08.478557 5618 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:08.479391 6692 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.480444 5618 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:08.480715 7368 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:08.481921 5618 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:08.482532 7142 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.483690 7298 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:08.483884 7142 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.449538 7337 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.486282 7337 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.485152 7298 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.478046 5503 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:08.487830 7298 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:08.454166 5552 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:08.490906 7360 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:08.479436 7323 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:08.495862 7295 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:08.496459 7323 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:08.497466 7323 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:08.439635 7246 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.504806 5656 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 13:33:08.505980 7368 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:08.508620 7293 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:08.485731 7142 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.459223 7248 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:08.520375 7174 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.520165 7368 raft_consensus.cc:686] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:08.452545 7296 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:08.540370 5390 catalog_manager.cc:5495] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 1 to 3, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 3 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:33:08.492502 7360 raft_consensus.cc:686] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:33:08.594725 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 207570us
I20260807 13:33:08.594017 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.599666 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:08.600874 5764 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.613127 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:08.614570 5767 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.624539 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.625587 5555 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:08.631139 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:08.635689 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.642616 5656 raft_consensus.cc:1261] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:08.642740 5661 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:08.646000 5661 raft_consensus.cc:1261] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:08.668294 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:08.673061 7311 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:08.669695 5659 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
W20260807 13:33:08.692778 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 66544.4us
I20260807 13:33:08.698851 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:08.699816 5555 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.719110 5542 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 13:33:08.740787 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:08.742864 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.743914 5542 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:08.741524 7360 consensus_queue.cc:237] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:08.741595 5762 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.645421 7201 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.748184 7164 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260807 13:33:08.766317 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 165031us
I20260807 13:33:08.765666 5764 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:08.644138 7368 consensus_queue.cc:237] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.782565 5556 raft_consensus.cc:1261] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:08.788918 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:08.790359 5543 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:08.805414 5620 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.821403 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:08.839279 5762 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:08.858397 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:08.859539 5662 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.807957 7278 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:08.803598 7275 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:08.903846 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:08.904692 5764 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:08.905012 5762 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.908566 5501 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.917421 5767 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:08.864696 7381 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:08.830400 7298 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:08.928867 5501 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:08.913879 7266 consensus_meta.cc:287] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.574s user 0.002s sys 0.021s
I20260807 13:33:08.906983 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:08.915853 7289 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:08.918694 7164 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:08.935402 7381 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.969597 5767 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 13:33:08.987072 5722 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:08.990512 7167 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:08.991264 7167 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:08.992261 7167 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:08.904573 7278 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:09.019084 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 55642.3us
I20260807 13:33:08.920647 7275 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.082114 7338 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:09.082933 7385 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:09.083830 7338 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.106829 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:09.084985 7385 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:09.136453 5555 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:08.940918 7266 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.122359 7295 consensus_queue.cc:1035] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260807 13:33:09.127555 5662 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:09.087669 7339 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:09.106240 5548 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260807 13:33:09.092041 7375 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.154s user 0.002s sys 0.000s
I20260807 13:33:08.967299 7289 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:09.019944 7381 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:09.102075 7298 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:09.211668 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:09.215346 5767 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260807 13:33:09.216254 7382 log.cc:924] Time spent T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.129s user 0.000s sys 0.001s
I20260807 13:33:09.171499 7201 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:09.021684 7164 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:09.210188 6692 consensus_meta.cc:287] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 0.729s user 0.018s sys 0.005s
I20260807 13:33:09.220820 5761 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:09.197077 7339 raft_consensus.cc:686] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:09.180671 7320 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260807 13:33:09.145337 7385 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:09.237097 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 384672us
I20260807 13:33:09.235523 6692 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:09.257367 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:09.255483 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 252223us
I20260807 13:33:09.231720 7072 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:09.255206 5618 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.633s user 0.013s sys 0.001s
W20260807 13:33:09.427460 5618 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.805s user 0.013s sys 0.001s
I20260807 13:33:09.315375 5762 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:09.438635 5722 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:09.449362 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 100746us
I20260807 13:33:09.452615 7295 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:09.454185 7295 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.455142 7164 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:09.461665 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:09.460793 7339 consensus_queue.cc:237] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.461676 7295 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:09.470822 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:09.260831 7363 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:09.493121 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:09.495760 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:09.319748 7275 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:09.483247 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:09.320933 7377 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.404s user 0.003s sys 0.000s
I20260807 13:33:09.240108 7076 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.249s
I20260807 13:33:09.428949 7266 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:09.426455 7201 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:09.527397 5543 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 4
W20260807 13:33:09.511050 7348 consensus_meta.cc:287] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.046s user 0.008s sys 0.020s
I20260807 13:33:09.532629 7338 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:09.535434 7179 consensus_meta.cc:287] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.076s user 0.007s sys 0.014s
I20260807 13:33:09.536350 7278 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:09.548947 5662 raft_consensus.cc:1261] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:33:09.618551 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 256520us
I20260807 13:33:09.619565 5499 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:09.472055 5555 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:09.622526 7339 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:09.624083 5499 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:09.623622 7339 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.625753 7309 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:09.626451 7309 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:09.627079 7309 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:09.628168 5499 leader_election.cc:398] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
I20260807 13:33:09.629344 7390 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:09.519168 7384 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:09.631492 7384 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:09.630543 7390 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.632364 7384 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:09.525491 7337 consensus_meta.cc:287] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.038s user 0.023s sys 0.002s
I20260807 13:33:09.562275 5554 raft_consensus.cc:1261] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:09.636134 7316 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:09.637290 7337 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.639613 7339 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:09.640502 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:09.565404 7391 log.cc:924] Time spent T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.127s user 0.002s sys 0.000s
I20260807 13:33:09.648695 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1115) took 1364 ms. Trace:
W20260807 13:33:09.541844 7340 consensus_meta.cc:287] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.201s user 0.019s sys 0.003s
I20260807 13:33:09.552058 5618 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:09.650908 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 98996.1us
I20260807 13:33:09.649946 7340 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.652078 5618 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:09.653498 7278 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:09.654853 7278 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:09.655201 7340 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:09.656677 7340 consensus_queue.cc:1035] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:09.594661 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:09.696784 5556 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:09.557574 7246 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:09.610061 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:09.611398 5543 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:09.585414 7179 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.314383 7385 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.207s
I20260807 13:33:09.591732 7201 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:09.589298 7355 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:09.568267 7348 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:09.616513 7296 consensus_meta.cc:287] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.997s user 0.016s sys 0.008s
I20260807 13:33:09.628698 5499 leader_election.cc:401] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:09.649245 5667 rpcz_store.cc:276] 0807 13:33:08.283840 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.284010 (+ 170us) service_pool.cc:227] Handling call
0807 13:33:08.872265 (+588255us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:08.872644 (+ 379us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:08.909740 (+ 37096us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:08.909812 (+ 72us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:08.932409 (+ 22597us) log.cc:842] Serialized 26 byte log entry
0807 13:33:09.201026 (+268617us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:09.618708 (+417682us) log.cc:842] Serialized 14 byte log entry
0807 13:33:09.621204 (+ 2496us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:09.621328 (+ 124us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:09.648171 (+ 26843us) raft_consensus.cc:1671] finished
0807 13:33:09.648388 (+ 217us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:09.648570 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29016,"raft.queue_time_us":43541,"raft.run_cpu_time_us":500,"raft.run_wall_time_us":9903,"spinlock_wait_cycles":56172928,"thread_start_us":660376,"threads_started":2,"wal-append.queue_time_us":268658}
I20260807 13:33:09.660166 5618 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:09.521178 7363 raft_consensus.cc:686] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:09.580865 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:09.487411 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 244727us
I20260807 13:33:09.674301 7298 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
W20260807 13:33:09.685717 7323 consensus_meta.cc:287] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.178s user 0.014s sys 0.010s
I20260807 13:33:09.894492 7323 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.664299 7275 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:09.899084 5665 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:09.661814 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:09.481601 7072 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.717828 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:09.707499 7337 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:09.715822 7278 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:09.834375 7393 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:09.677664 7289 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:09.845440 5555 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
W20260807 13:33:09.855252 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 227435us
I20260807 13:33:09.921130 5499 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
W20260807 13:33:09.829762 7142 consensus_meta.cc:287] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.318s user 0.023s sys 0.000s
I20260807 13:33:09.863974 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 35) took 1350 ms. Trace:
I20260807 13:33:09.874544 7407 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:09.878798 7076 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
I20260807 13:33:09.824919 7368 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:09.905123 5770 raft_consensus.cc:2354] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:09.709452 7246 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.854184 7296 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.898723 7275 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.907321 5556 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:09.841483 7390 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:09.711524 7266 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:09.829186 7355 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:09.902971 7167 consensus_meta.cc:287] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.909s user 0.014s sys 0.011s
I20260807 13:33:09.935527 7412 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:09.937259 7374 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:09.926062 5660 rpcz_store.cc:276] 0807 13:33:08.514005 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.514557 (+ 552us) service_pool.cc:227] Handling call
0807 13:33:08.518794 (+ 4237us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:08.523527 (+ 4733us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:08.523636 (+ 109us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:08.525088 (+ 1452us) log.cc:842] Serialized 26 byte log entry
0807 13:33:08.710906 (+185818us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:08.721858 (+ 10952us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:08.751422 (+ 29564us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:09.717382 (+965960us) raft_consensus.cc:1671] finished
0807 13:33:09.729561 (+ 12179us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:09.855521 (+125960us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":60929,"raft.run_cpu_time_us":451,"raft.run_wall_time_us":40603,"thread_start_us":170402,"threads_started":1,"wal-append.queue_time_us":281748}
I20260807 13:33:09.903934 7298 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:09.910974 6637 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:09.929518 7323 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.028378 7323 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:09.992637 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:10.029287 6691 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 13:33:09.922349 7363 consensus_queue.cc:237] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.999670 5722 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:09.918375 7278 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.962766 5663 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:10.016333 7179 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:09.987573 7167 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.944428 7340 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:10.048312 7340 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.050741 7278 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.051662 7278 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:10.051159 5389 catalog_manager.cc:5495] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:10.052337 7278 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.017797 7337 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:10.032475 7246 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.029610 7323 raft_consensus.cc:686] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:10.018940 7374 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:10.058465 7374 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:10.018688 7412 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:09.938696 7393 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.939815 7407 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:09.943235 7368 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.025812 6692 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 13:33:09.928678 7142 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.021426 7201 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:10.077196 5556 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:10.086711 7072 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.033517 7296 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:09.985953 7266 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.104905 7340 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.087301 7348 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.105597 7298 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:10.112638 5658 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:10.054589 7337 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.120049 6688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57212 (request call id 91) took 1356 ms. Trace:
I20260807 13:33:10.120254 7278 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.057806 7323 consensus_queue.cc:237] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.085654 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1131) took 1260 ms. Trace:
I20260807 13:33:10.090133 7261 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:33:10.107384 5665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 740) took 1506 ms (client timeout 1749 ms). Trace:
I20260807 13:33:10.116762 7368 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.129621 7372 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:10.099030 7167 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.113806 7266 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.143652 5556 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
W20260807 13:33:10.152654 5665 rpcz_store.cc:269] 0807 13:33:08.592537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.593606 (+ 1069us) service_pool.cc:227] Handling call
0807 13:33:10.098230 (+1504624us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002b9dd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:10.098453 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2986914176}
W20260807 13:33:10.141319 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 480950us
I20260807 13:33:10.138386 5666 rpcz_store.cc:276] 0807 13:33:08.824972 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.826197 (+ 1225us) service_pool.cc:227] Handling call
0807 13:33:08.870570 (+ 44373us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:09.212991 (+342421us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:09.213041 (+ 50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:09.213102 (+ 61us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:09.213145 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:10.085360 (+872215us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54000cf654. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:10.085415 (+ 55us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:10.085561 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":786584832}
W20260807 13:33:10.163959 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.200s user 0.013s sys 0.104s
W20260807 13:33:10.164903 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.206s user 0.014s sys 0.104s
W20260807 13:33:10.165367 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 1.20739e+06us
I20260807 13:33:10.132658 6688 rpcz_store.cc:276] 0807 13:33:08.784511 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.815325 (+ 30814us) service_pool.cc:227] Handling call
0807 13:33:08.921489 (+106164us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:09.312833 (+391344us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:09.369676 (+ 56843us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:09.446877 (+ 77201us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:09.473807 (+ 26930us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:10.119362 (+645555us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54005415d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:10.119468 (+ 106us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:10.119869 (+ 401us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":753118464}
I20260807 13:33:10.165048 7261 raft_consensus.cc:686] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:10.184823 5503 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:10.196202 5618 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:10.211603 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:10.212904 5555 raft_consensus.cc:2379] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:10.212841 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:10.213140 7407 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.214052 5543 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:10.218403 7114 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:10.219029 7393 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.220067 7393 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:10.228812 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.231729 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.231849 5555 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:10.232126 7142 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.232893 5545 raft_consensus.cc:2379] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:10.198666 7381 consensus_meta.cc:287] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.986s user 0.010s sys 0.014s
I20260807 13:33:10.221246 7393 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.237449 7378 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:10.238494 7278 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:10.238631 7365 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:10.245494 5663 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:10.229301 7216 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:10.263084 7278 raft_consensus.cc:686] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:10.170296 7372 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.256596 7114 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:10.277878 5723 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.614s user 0.037s sys 0.054s
I20260807 13:33:10.277341 7114 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:10.278728 5723 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.738s user 0.039s sys 0.054s
I20260807 13:33:10.253504 7311 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260807 13:33:10.254473 7412 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:10.270910 7076 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:10.270280 7378 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.254907 7393 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.242024 7298 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260807 13:33:10.271162 7355 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.297190 7266 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:10.301075 7266 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.302260 7076 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.294287 7167 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:10.305063 7167 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.277910 7261 consensus_queue.cc:237] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:10.307474 7309 consensus_meta.cc:287] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.680s user 0.017s sys 0.005s
I20260807 13:33:10.308223 7309 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.310503 7412 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:10.311622 7412 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.293584 7311 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:10.281720 7216 raft_consensus.cc:686] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:10.269105 7278 consensus_queue.cc:237] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.319221 7311 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.270326 7365 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.250126 7381 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.336203 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:10.342833 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:10.336865 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:10.345409 5767 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:10.338037 5552 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:10.338969 7413 log.cc:924] Time spent T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.599s user 0.002s sys 0.008s
I20260807 13:33:10.339491 7311 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.347721 7293 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:10.365199 7337 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.366809 7320 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:10.368762 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.369750 5545 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:10.341825 7252 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:10.371785 7252 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.372509 7293 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:10.378518 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 697) took 2250 ms. Trace:
I20260807 13:33:10.379192 5553 rpcz_store.cc:276] 0807 13:33:08.127645 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.127801 (+ 156us) service_pool.cc:227] Handling call
0807 13:33:10.360176 (+2232375us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54000ffad4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:10.378362 (+ 18186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4980170112}
I20260807 13:33:10.315728 7355 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:10.369650 5722 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:10.386374 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:10.389133 5722 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:10.323220 7216 consensus_queue.cc:237] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:10.393946 7167 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.391079 7275 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:10.397027 5761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32950 (request call id 775) took 2303 ms (client timeout 1970 ms). Trace:
I20260807 13:33:10.387367 7293 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:10.398746 7417 log.cc:924] Time spent T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Append to log took a long time: real 0.089s user 0.001s sys 0.000s
I20260807 13:33:10.399876 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1126) took 1583 ms. Trace:
I20260807 13:33:10.400331 5659 rpcz_store.cc:276] 0807 13:33:08.816097 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.818314 (+ 2217us) service_pool.cc:227] Handling call
0807 13:33:08.818924 (+ 610us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:09.159708 (+340784us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:09.159762 (+ 54us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:09.159832 (+ 70us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:09.159875 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:10.399541 (+1239666us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b540024c2d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:10.399608 (+ 67us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:10.399793 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":782979968}
W20260807 13:33:10.397714 5761 rpcz_store.cc:269] 0807 13:33:08.093386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.093964 (+ 578us) service_pool.cc:227] Handling call
0807 13:33:10.396618 (+2302654us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400288054. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:10.396847 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2313111296}
I20260807 13:33:10.327793 7266 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.407511 5722 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:10.421838 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1127) took 1605 ms. Trace:
I20260807 13:33:10.413972 7372 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.390733 7250 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:10.440210 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.446327 5543 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:10.484869 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:10.406553 7355 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.482508 7378 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.417419 7381 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.492916 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:10.422770 5663 rpcz_store.cc:276] 0807 13:33:08.816738 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.834222 (+ 17484us) service_pool.cc:227] Handling call
0807 13:33:10.419182 (+1584960us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54000e42d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:10.421725 (+ 2543us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2293699456}
I20260807 13:33:10.512951 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:10.514609 5762 raft_consensus.cc:2354] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:10.508387 7374 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.517177 7309 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.508414 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:10.523408 5761 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:10.526521 7412 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.457703 7348 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:10.527079 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:10.527801 7348 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:10.528580 7348 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:10.528375 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:10.529881 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:10.531086 5771 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:10.526633 7352 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:10.549376 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.540616 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.543618 5552 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:10.533469 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:10.553284 5769 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:10.556556 5764 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:10.490482 7076 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.572945 7374 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.575595 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:10.538223 7365 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.529888 5761 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:10.591425 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1130) took 1767 ms. Trace:
I20260807 13:33:10.592139 7252 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.592175 5661 rpcz_store.cc:276] 0807 13:33:08.824331 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.825187 (+ 856us) service_pool.cc:227] Handling call
0807 13:33:08.825772 (+ 585us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:09.137687 (+311915us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:09.137808 (+ 121us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:09.137916 (+ 108us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:09.137980 (+ 64us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:10.590968 (+1452988us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54001badd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:10.591058 (+ 90us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:10.591316 (+ 258us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":716280704}
W20260807 13:33:10.568130 7384 consensus_meta.cc:287] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.935s user 0.023s sys 0.001s
I20260807 13:33:10.596189 7384 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.606230 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:10.566826 7352 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:10.532557 7114 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:10.560127 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:10.581712 7355 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.627351 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.615760 7250 raft_consensus.cc:686] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:10.628258 5762 raft_consensus.cc:2354] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:10.618942 7352 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:10.623620 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.625172 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.577419 5766 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:10.632440 5545 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:10.628268 5767 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:10.642874 5770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1128) took 1889 ms. Trace:
I20260807 13:33:10.630841 7368 raft_consensus.cc:3032] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:10.643635 5770 rpcz_store.cc:276] 0807 13:33:08.751216 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:09.106383 (+355167us) service_pool.cc:227] Handling call
0807 13:33:10.640166 (+1533783us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400035a54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:10.640400 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1772870912}
I20260807 13:33:10.673702 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 737) took 1016 ms. Trace:
I20260807 13:33:10.674620 5552 rpcz_store.cc:276] 0807 13:33:09.657553 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:09.660500 (+ 2947us) service_pool.cc:227] Handling call
0807 13:33:10.673092 (+1012592us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54001a3bd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:10.673604 (+ 512us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":985859840}
I20260807 13:33:10.688992 7250 consensus_queue.cc:237] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.746276 5722 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:10.761613 7416 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:10.762025 7383 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:10.764065 7383 raft_consensus.cc:686] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:10.778443 7384 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:10.740746 7348 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:10.669111 7368 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:10.704135 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1132) took 1877 ms. Trace:
I20260807 13:33:10.743929 7085 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:10.763199 7416 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.787114 5771 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260807 13:33:10.788479 5721 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.967s user 0.018s sys 0.039s
I20260807 13:33:10.743251 7295 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:10.795606 5721 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.975s user 0.019s sys 0.039s
W20260807 13:33:10.791397 5542 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.176s user 0.017s sys 0.054s
W20260807 13:33:10.797538 5542 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.182s user 0.018s sys 0.055s
I20260807 13:33:10.795807 5722 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:10.812443 5722 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:10.865593 5543 raft_consensus.cc:1261] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:33:10.881531 5499 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.959s user 0.003s sys 0.044s
I20260807 13:33:10.884093 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:10.793049 7085 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:10.884120 5499 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.962s user 0.003s sys 0.044s
I20260807 13:33:10.885433 5552 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:10.895556 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 974566us
W20260807 13:33:10.899678 5548 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.911s user 0.010s sys 0.014s
W20260807 13:33:10.900945 5548 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.912s user 0.010s sys 0.014s
I20260807 13:33:10.786631 5656 rpcz_store.cc:276] 0807 13:33:08.827014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.829674 (+ 2660us) service_pool.cc:227] Handling call
0807 13:33:10.605886 (+1776212us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:10.667971 (+ 62085us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":47486208}
W20260807 13:33:10.866398 6639 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.906s user 0.027s sys 0.041s
I20260807 13:33:10.845441 7390 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:10.866529 7373 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:33:10.957525 5725 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.893s user 0.020s sys 0.028s
W20260807 13:33:10.958727 5725 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.899s user 0.020s sys 0.028s
I20260807 13:33:10.805308 7295 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:10.867177 7384 consensus_queue.cc:1035] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260807 13:33:10.970863 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:10.978973 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:11.003880 5543 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:11.007082 5722 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:10.973863 5616 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.866s user 0.027s sys 0.060s
W20260807 13:33:11.009205 5616 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.128s user 0.029s sys 0.066s
I20260807 13:33:11.002841 5545 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:10.939736 6639 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.964s user 0.029s sys 0.041s
I20260807 13:33:10.939592 7307 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:11.020956 5391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51228 (request call id 180) took 2862 ms. Trace:
I20260807 13:33:11.033212 5501 leader_election.cc:398] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:11.033717 5501 leader_election.cc:401] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:10.940025 7309 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
W20260807 13:33:11.069859 5618 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.866s user 0.012s sys 0.005s
W20260807 13:33:11.070396 5618 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.867s user 0.012s sys 0.005s
I20260807 13:33:11.003918 7289 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:10.967706 7372 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:11.018714 7179 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:33:11.070855 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 874656us
I20260807 13:33:10.845875 7368 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:11.015926 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 71495.8us
I20260807 13:33:11.092135 5552 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:10.956810 7167 consensus_queue.cc:1035] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260807 13:33:11.004145 7373 raft_consensus.cc:686] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:10.972892 7390 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:11.028041 5391 rpcz_store.cc:276] 0807 13:33:08.155134 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.155305 (+ 171us) service_pool.cc:227] Handling call
0807 13:33:11.013146 (+2857841us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":10}
W20260807 13:33:11.030714 7261 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s user 0.004s sys 0.010s
W20260807 13:33:11.076241 6636 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.108s user 0.007s sys 0.027s
I20260807 13:33:10.956763 7355 consensus_queue.cc:1035] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260807 13:33:11.066732 7339 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:11.082981 7416 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:11.035097 7392 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:11.103331 5722 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:11.065548 7266 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:11.099602 5618 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:11.077653 7251 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:11.073630 7252 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:11.100314 7348 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:11.226497 7409 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:11.220925 7419 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:11.080477 7309 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:11.077085 7307 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:11.127168 7390 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:11.107754 7306 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:11.100704 7323 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s user 0.033s sys 0.059s
W20260807 13:33:11.150831 7261 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s user 0.004s sys 0.014s
I20260807 13:33:11.099690 7179 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:11.094004 7201 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
W20260807 13:33:11.148303 6636 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.188s user 0.008s sys 0.029s
I20260807 13:33:11.098487 7418 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:11.105726 5771 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:11.158375 7278 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s user 0.010s sys 0.015s
I20260807 13:33:11.268028 5545 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:11.222939 5394 catalog_manager.cc:5495] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193), VOTER 737c581af06a42df94970a1542600159 (127.3.187.195), VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 3 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:11.269912 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 730) took 1667 ms. Trace:
W20260807 13:33:11.273072 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 175833us
I20260807 13:33:10.939675 7383 consensus_queue.cc:237] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:11.206813 7363 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.041s user 0.020s sys 0.049s
I20260807 13:33:11.095108 7289 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:11.174537 7368 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:11.099411 7372 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.222223 7387 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.250s
I20260807 13:33:11.247128 7416 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:11.578709 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.378s user 0.010s sys 0.054s
W20260807 13:33:11.671609 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.471s user 0.010s sys 0.058s
W20260807 13:33:11.626323 5725 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.530s user 0.003s sys 0.008s
W20260807 13:33:11.672232 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 1.47127e+06us
W20260807 13:33:11.672530 5725 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.604s user 0.003s sys 0.010s
I20260807 13:33:11.296123 7384 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:11.612563 5501 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.195:43427 timed out after 1.577s (SENT) [suppressed 1 similar messages]
W20260807 13:33:11.412330 5621 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.560s user 0.007s sys 0.023s
W20260807 13:33:11.685259 5621 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.845s user 0.008s sys 0.028s
I20260807 13:33:11.693894 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:11.667640 7443 log.cc:924] Time spent T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.261s user 0.000s sys 0.001s
W20260807 13:33:11.301911 7323 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.055s user 0.037s sys 0.062s
W20260807 13:33:11.622366 7250 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s user 0.007s sys 0.030s
W20260807 13:33:11.623340 7216 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.092s user 0.010s sys 0.036s
I20260807 13:33:11.304314 7114 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:11.302713 7085 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:11.302932 6692 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s user 0.010s sys 0.020s
I20260807 13:33:11.307144 7179 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:11.383536 7261 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:11.677248 7414 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:11.269831 6688 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s user 0.016s sys 0.039s
W20260807 13:33:11.683456 7363 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.561s user 0.023s sys 0.054s
I20260807 13:33:11.298784 7251 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:11.378794 7419 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.307648 7306 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.720471 7384 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:11.803293 6692 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s user 0.017s sys 0.033s
I20260807 13:33:11.805018 7307 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:11.490583 6637 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.403s user 0.048s sys 0.078s
I20260807 13:33:11.287071 7266 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.636046 7426 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:11.674000 7278 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.107s user 0.015s sys 0.018s
I20260807 13:33:11.701696 5394 catalog_manager.cc:5495] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:11.603734 7431 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:11.570815 7444 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:11.662549 7432 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:11.416033 7295 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:11.548126 7339 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:11.932791 6637 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.854s user 0.050s sys 0.097s
I20260807 13:33:11.290688 7252 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.406090 7373 consensus_queue.cc:237] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.679538 7416 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:11.798802 7250 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s user 0.007s sys 0.032s
W20260807 13:33:11.799175 7216 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.268s user 0.011s sys 0.036s
I20260807 13:33:11.801201 7309 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:11.809504 7323 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:33:11.825037 6688 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.465s user 0.021s sys 0.040s
I20260807 13:33:11.350210 7201 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:11.686328 5542 rpcz_store.cc:276] 0807 13:33:09.575720 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:09.576065 (+ 345us) service_pool.cc:227] Handling call
0807 13:33:09.576662 (+ 597us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:09.613694 (+ 37032us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:09.613734 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:09.614665 (+ 931us) log.cc:842] Serialized 26 byte log entry
0807 13:33:10.798559 (+1183894us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:10.798654 (+ 95us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:10.798802 (+ 148us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:11.242903 (+444101us) raft_consensus.cc:1671] finished
0807 13:33:11.242962 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:11.243260 (+ 298us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":338,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":6994,"thread_start_us":1183163,"threads_started":1,"wal-append.queue_time_us":1468254}
I20260807 13:33:11.900533 5544 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:11.699256 7392 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.348097 7409 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.943361 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:11.834645 7430 raft_consensus.cc:3032] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:11.835834 7261 raft_consensus.cc:686] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:11.698663 7418 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:11.939476 7352 consensus_meta.cc:287] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.309s user 0.011s sys 0.011s
I20260807 13:33:11.827133 7114 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.846588 7414 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:11.997052 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:12.033347 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:11.941445 7426 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.040022 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:11.945216 7431 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:12.041471 5499 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.945s user 0.000s sys 0.025s
I20260807 13:33:11.963380 7339 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.031486 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:12.079980 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:12.080797 5769 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:12.050140 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 698) took 1641 ms. Trace:
I20260807 13:33:12.081635 5553 rpcz_store.cc:276] 0807 13:33:10.396423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:10.400760 (+ 4337us) service_pool.cc:227] Handling call
0807 13:33:12.036740 (+1635980us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54003976d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:12.037648 (+ 908us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3657689344}
W20260807 13:33:11.993300 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 2.08982e+06us
W20260807 13:33:12.079038 5499 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.982s user 0.000s sys 0.026s
W20260807 13:33:12.083657 5765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32950 (request call id 799) took 1600 ms (client timeout 2058 ms). Trace:
I20260807 13:33:12.039458 7323 raft_consensus.cc:686] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:12.084030 5765 rpcz_store.cc:269] 0807 13:33:10.483759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:10.484412 (+ 653us) service_pool.cc:227] Handling call
0807 13:33:12.078756 (+1594344us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54003c69d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:12.083593 (+ 4837us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3445686528}
I20260807 13:33:12.040198 7430 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:12.093528 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:12.072027 5767 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:11.946851 7444 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.049525 7387 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:11.949882 7432 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:12.063578 7352 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:12.316259 5618 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.632s user 0.000s sys 0.019s
I20260807 13:33:12.192657 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:12.372696 5618 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.688s user 0.002s sys 0.021s
W20260807 13:33:12.176817 5503 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.024s user 0.047s sys 0.113s
I20260807 13:33:12.249293 7266 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:12.289716 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.616s user 0.002s sys 0.033s
W20260807 13:33:12.381260 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.708s user 0.002s sys 0.049s
I20260807 13:33:12.361478 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 762) took 3669 ms. Trace:
W20260807 13:33:12.381625 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 708363us
I20260807 13:33:12.169406 7323 consensus_queue.cc:237] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.381976 5544 rpcz_store.cc:276] 0807 13:33:08.681685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.692154 (+ 10469us) service_pool.cc:227] Handling call
0807 13:33:10.121348 (+1429194us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b5800003398. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:10.121817 (+ 469us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:12.037813 (+1915996us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:12.315825 (+278012us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540025fdd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:12.350620 (+ 34795us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4089414272}
I20260807 13:33:12.383255 5620 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:12.384037 7438 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:12.384835 7432 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:12.316068 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 273628us
W20260807 13:33:12.255254 7421 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 1.225s user 0.020s sys 0.006s
I20260807 13:33:12.151926 7289 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:12.386457 7421 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 1.368s user 0.023s sys 0.012s
W20260807 13:33:12.373487 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 689503us
I20260807 13:33:12.156920 7372 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:12.274595 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 418194us
I20260807 13:33:12.390133 7372 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:12.390828 7372 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.393575 7372 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.308614 7252 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:12.194087 7430 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:12.371721 7416 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:12.397753 5501 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.653s user 0.003s sys 0.009s
W20260807 13:33:12.308703 7422 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.050s user 0.009s sys 0.012s
W20260807 13:33:12.196877 5548 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.131s user 0.003s sys 0.024s
W20260807 13:33:12.399221 5501 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.654s user 0.004s sys 0.009s
W20260807 13:33:12.399525 5548 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.334s user 0.019s sys 0.043s
W20260807 13:33:12.399657 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 787137us
W20260807 13:33:12.197012 5722 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.925s user 0.017s sys 0.015s
W20260807 13:33:12.402724 5722 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.131s user 0.023s sys 0.043s
W20260807 13:33:12.403110 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 1.2999e+06us
I20260807 13:33:12.095337 5656 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:12.154197 7433 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:12.236557 7251 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:12.107297 5500 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.868s user 0.033s sys 0.066s
I20260807 13:33:12.389096 7444 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:12.407954 7422 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.174s user 0.012s sys 0.014s
I20260807 13:33:12.186416 7306 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.247892 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:12.371368 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:12.373488 5503 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.221s user 0.062s sys 0.123s
I20260807 13:33:12.385973 5620 leader_election.cc:398] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:12.461033 5620 leader_election.cc:401] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:33:12.154597 7261 consensus_queue.cc:237] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:12.410161 5621 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.699s user 0.008s sys 0.005s
W20260807 13:33:12.469321 5621 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.783s user 0.009s sys 0.006s
I20260807 13:33:12.416793 7384 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:12.386901 7352 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:12.409849 7438 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:12.414770 5771 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s user 0.002s sys 0.011s
I20260807 13:33:12.418341 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:12.494006 5771 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s user 0.004s sys 0.012s
W20260807 13:33:12.423341 5500 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.271s user 0.048s sys 0.087s
I20260807 13:33:12.487742 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:12.425859 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:12.495677 5659 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:12.427012 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:12.194295 7390 consensus_meta.cc:287] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.867s user 0.014s sys 0.001s
I20260807 13:33:12.427639 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:12.497478 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:12.255503 7419 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.430632 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:12.380550 7387 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:12.371737 7414 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:12.365069 7201 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:12.351054 7455 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:12.399668 7456 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:12.406633 7316 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:12.416092 7409 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.467495 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:12.305709 7179 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.419263 7372 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:12.659421 7372 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:12.660759 7446 log.cc:924] Time spent T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.244s user 0.000s sys 0.000s
I20260807 13:33:12.431371 7433 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.662377 6692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57224 (request call id 123) took 2255 ms. Trace:
I20260807 13:33:12.663636 7433 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.487085 5722 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:12.664746 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 177736us
W20260807 13:33:12.488632 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 102773us
I20260807 13:33:12.666025 5620 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:12.496480 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:12.666707 7479 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:12.666963 5659 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:12.667361 7479 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:12.668781 7383 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:12.669308 7383 raft_consensus.cc:686] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:12.503496 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:12.432953 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:12.452765 7309 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:12.433668 7392 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.579761 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:12.553479 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 56949.9us
I20260807 13:33:12.584299 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:12.452035 7216 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:12.498108 5667 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:12.584755 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:12.592270 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:12.596104 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 100748us
I20260807 13:33:12.730438 5661 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:12.469233 7266 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:12.457019 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:12.490612 7339 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.450714 7252 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:12.453161 7114 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.493536 7444 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:12.492502 7426 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:12.639991 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:12.641371 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:12.554476 7390 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.493688 7251 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:12.487493 7422 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:12.659698 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:12.659883 7441 log.cc:924] Time spent T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.297s user 0.000s sys 0.000s
I20260807 13:33:12.433377 7418 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.661875 7372 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.658607 6636 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:12.729758 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 63824.4us
I20260807 13:33:12.730950 5542 raft_consensus.cc:2379] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:12.596525 7431 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:12.450675 7363 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:12.580039 7438 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.636796 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:12.591246 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 489820us
I20260807 13:33:12.643266 7455 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:13.162998 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 451980us
I20260807 13:33:13.167598 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 740) took 3180 ms. Trace:
I20260807 13:33:13.168097 5548 rpcz_store.cc:276] 0807 13:33:09.986896 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:09.987367 (+ 471us) service_pool.cc:227] Handling call
0807 13:33:09.987919 (+ 552us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:10.910958 (+923039us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:10.911087 (+ 129us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:10.962006 (+ 50919us) log.cc:842] Serialized 26 byte log entry
0807 13:33:12.400410 (+1438404us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:12.400483 (+ 73us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:12.400647 (+ 164us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:13.167322 (+766675us) raft_consensus.cc:1671] finished
0807 13:33:13.167367 (+ 45us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:13.167523 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":59518,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":201,"thread_start_us":2247560,"threads_started":2,"wal-append.queue_time_us":1472532}
I20260807 13:33:13.003857 7464 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:13.170626 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.171427 5548 raft_consensus.cc:2379] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:13.172255 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.172860 5548 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:13.173655 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.173761 5620 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:13.174293 5548 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:13.174714 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.175119 5666 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:13.175180 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.175884 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.176041 5548 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:13.176354 7363 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:13.177205 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:12.839395 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:13.178296 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:12.838726 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:13.095225 7307 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:13.179301 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:13.179992 5548 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:33:12.834785 7475 log.cc:924] Time spent T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.252s user 0.001s sys 0.000s
I20260807 13:33:13.179776 7307 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:13.181511 5766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1135) took 1489 ms. Trace:
I20260807 13:33:13.181267 7251 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:13.182462 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:12.774763 7442 log.cc:924] Time spent T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.485s user 0.001s sys 0.001s
I20260807 13:33:13.183394 7251 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:12.740291 7278 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:13.184638 7278 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:13.184707 5621 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:13.185213 7278 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:13.169970 5552 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:13.185726 5767 raft_consensus.cc:1261] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:13.181900 5766 rpcz_store.cc:276] 0807 13:33:11.692708 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:11.697413 (+ 4705us) service_pool.cc:227] Handling call
0807 13:33:11.817956 (+120543us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:11.833740 (+ 15784us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:11.833824 (+ 84us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:11.901936 (+ 68112us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b2c00088b18. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff680d59e11 00007ff680d69442 00007ff6823b1c11 00007ff68237658a 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772
0807 13:33:11.903033 (+ 1097us) log.cc:842] Serialized 527 byte log entry
0807 13:33:12.307973 (+404940us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:12.308498 (+ 525us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:12.321008 (+ 12510us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:13.181174 (+860166us) raft_consensus.cc:1671] finished
0807 13:33:13.181199 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:13.181423 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4631,"raft.queue_time_us":9254,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":266,"spinlock_wait_cycles":148327168,"thread_start_us":351755,"threads_started":1,"wal-append.queue_time_us":529407}
I20260807 13:33:13.186403 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.186511 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:13.187482 5552 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:13.187575 7409 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:13.187791 5763 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:13.188041 7409 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:13.188743 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:13.189358 5769 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:13.176535 5554 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:12.740872 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.190786 5556 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:13.191414 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:13.191494 7252 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:13.192611 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:13.193259 5767 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:13.192596 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:13.186319 5663 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:13.194048 5762 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:13.195080 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:12.740137 7266 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:13.198614 7447 log.cc:924] Time spent T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.909s user 0.004s sys 0.007s
I20260807 13:33:13.198470 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.180860 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.198485 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:13.200362 7266 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:13.198475 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.201858 7201 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:13.202414 7201 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:13.204031 5620 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:13.202073 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.205469 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:13.094259 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.206528 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.040474 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.208424 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:12.642668 7316 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:13.211786 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.212524 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:12.935029 6680 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 13:33:13.193886 7252 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:13.169945 7464 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:12.840025 7476 log.cc:924] Time spent T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.138s user 0.000s sys 0.000s
W20260807 13:33:13.250779 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 114480us
I20260807 13:33:13.252818 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:12.941097 7368 consensus_meta.cc:287] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.218s user 0.010s sys 0.000s
I20260807 13:33:12.887935 7486 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:12.879702 7494 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:13.255610 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:13.257666 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.212105 5545 raft_consensus.cc:2354] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:12.935904 7179 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:12.739073 7392 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:13.038848 7433 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:12.839887 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:12.936254 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:12.811914 7473 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:13.260670 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:13.094218 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:13.031432 7462 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:12.732301 7482 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:12.657971 7456 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.775056 7309 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:13.004406 7419 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:12.741544 7216 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:12.702597 7383 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:13.269027 7339 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:14.112166 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.112349 7339 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.113308 5763 raft_consensus.cc:2454] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
W20260807 13:33:14.114074 5544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 796) took 1377 ms (client timeout 1509 ms). Trace:
I20260807 13:33:13.269088 7363 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:14.114573 5544 rpcz_store.cc:269] 0807 13:33:12.736334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.887475 (+151141us) service_pool.cc:227] Handling call
0807 13:33:14.113989 (+1226514us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:13.298651 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 94686.8us
I20260807 13:33:13.245649 7307 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:13.216739 7409 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:14.117384 5545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 777) took 1655 ms (client timeout 1681 ms). Trace:
I20260807 13:33:14.117413 7433 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:13.368764 7521 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:13.257735 7114 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:14.119091 7473 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.119620 7433 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:14.120141 7114 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:14.121628 5552 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:33:13.386412 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 201773us
W20260807 13:33:13.854646 5765 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.644s user 0.003s sys 0.006s
W20260807 13:33:14.123620 5765 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.913s user 0.005s sys 0.007s
I20260807 13:33:13.258021 7435 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:14.124981 7438 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.125362 7435 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.125960 7435 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:13.253578 7422 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:13.315389 7373 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s user 0.007s sys 0.014s
I20260807 13:33:14.127213 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:13.254004 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 669813us
I20260807 13:33:13.697983 7483 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:13.248438 7479 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:13.616413 6688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57224 (request call id 122) took 3303 ms. Trace:
W20260807 13:33:13.502326 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 86740.5us
I20260807 13:33:13.256773 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:13.368157 7387 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:14.111585 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 365611us
I20260807 13:33:14.192869 5556 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:14.188476 5389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51216 (request call id 192) took 5686 ms. Trace:
I20260807 13:33:14.193105 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.131489 7486 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:14.117877 5545 rpcz_store.cc:269] 0807 13:33:12.462286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.462459 (+ 173us) service_pool.cc:227] Handling call
0807 13:33:13.110946 (+648487us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b5800003398. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:14.117328 (+1006382us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":74709760}
W20260807 13:33:14.182880 7373 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.451s user 0.007s sys 0.020s
I20260807 13:33:13.257040 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.130081 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.200686 5667 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:14.202406 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:14.202958 5542 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:14.185149 7528 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:14.203711 7528 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.204406 7387 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.178941 7252 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.205005 7387 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:14.205231 7252 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.205924 7309 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.206461 7309 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:14.207019 7486 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.206902 7309 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:14.207337 7252 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:14.184480 6685 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:14.208170 6685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57224 (request call id 127) took 1371 ms. Trace:
I20260807 13:33:14.208617 7387 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.208979 7309 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:14.208472 6685 rpcz_store.cc:276] 0807 13:33:12.837008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.839599 (+ 2591us) service_pool.cc:227] Handling call
0807 13:33:14.208094 (+1368495us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:14.209203 6691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57224 (request call id 126) took 1715 ms (client timeout 1776 ms). Trace:
I20260807 13:33:14.184815 7261 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:12.662896 6692 rpcz_store.cc:276] 0807 13:33:10.429946 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:10.458431 (+ 28485us) service_pool.cc:227] Handling call
0807 13:33:10.531226 (+ 72795us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:10.633346 (+102120us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:10.635856 (+ 2510us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:10.709335 (+ 73479us) log.cc:842] Serialized 527 byte log entry
0807 13:33:11.936394 (+1227059us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:11.939044 (+ 2650us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:11.945909 (+ 6865us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:12.662055 (+716146us) raft_consensus.cc:1671] finished
0807 13:33:12.662083 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:12.662280 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":10792,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":2543,"thread_start_us":1105742,"threads_started":1,"wal-append.queue_time_us":1546651}
I20260807 13:33:14.117931 5662 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:13.395645 7201 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:14.211968 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.131331 7363 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:13.399574 7499 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.176987 7307 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:13.642752 7512 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.249s user 0.000s sys 0.000s
I20260807 13:33:13.281975 5656 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
W20260807 13:33:13.856113 5666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.598s user 0.001s sys 0.010s
W20260807 13:33:14.218626 5666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.960s user 0.001s sys 0.014s
I20260807 13:33:14.219497 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 767) took 1025 ms. Trace:
I20260807 13:33:14.198348 7483 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:14.219803 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.219775 5544 rpcz_store.cc:276] 0807 13:33:13.193622 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.218778 (+1025156us) service_pool.cc:227] Handling call
0807 13:33:14.219089 (+ 311us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.219261 (+ 172us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.219285 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.219316 (+ 31us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:14.219340 (+ 24us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.219379 (+ 39us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.219455 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.220417 5666 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:14.221199 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.221997 5666 raft_consensus.cc:2396] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:13.615872 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 13:33:14.023480 7511 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.636s user 0.000s sys 0.009s
I20260807 13:33:13.528976 7418 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.140607 7430 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:14.154541 7179 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.235404 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.235950 5666 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:14.236523 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.237277 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:13.560858 7510 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:13.561561 7502 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.188519 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:13.750767 7444 consensus_meta.cc:287] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.532s user 0.009s sys 0.000s
I20260807 13:33:14.296654 7444 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:14.189599 5553 raft_consensus.cc:1261] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:14.298586 7422 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.304757 5665 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:13.699854 7500 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:13.651322 5663 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:13.648032 7505 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:14.195284 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.311260 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 770) took 1116 ms. Trace:
I20260807 13:33:14.311688 5545 rpcz_store.cc:276] 0807 13:33:13.194545 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.310306 (+1115761us) service_pool.cc:227] Handling call
0807 13:33:14.310654 (+ 348us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.310850 (+ 196us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.310884 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.310935 (+ 51us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:14.310977 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.311039 (+ 62us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.311196 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.115295 7482 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.193797 5543 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
W20260807 13:33:14.138597 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 342816us
I20260807 13:33:14.197661 5618 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:33:14.316087 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 118512us
I20260807 13:33:14.316208 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.182789 7419 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.319900 7419 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.320415 7444 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:14.320814 7444 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:14.321169 7444 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:14.321314 6638 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:13.856726 5721 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.605s user 0.002s sys 0.005s
W20260807 13:33:14.322211 5721 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.071s user 0.002s sys 0.008s
I20260807 13:33:14.322492 5503 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:14.116703 5620 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:14.323321 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 206733us
I20260807 13:33:14.324011 5620 leader_election.cc:398] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:14.324265 5620 leader_election.cc:401] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:33:14.325158 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.325547 5620 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.325791 6694 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:14.326676 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:13.705637 7278 consensus_meta.cc:287] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.520s user 0.007s sys 0.003s
I20260807 13:33:14.327636 7438 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.327556 7278 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.328090 7438 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.328536 7438 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.329614 7278 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:14.209630 6691 rpcz_store.cc:269] 0807 13:33:12.596265 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.656226 (+ 59961us) service_pool.cc:227] Handling call
0807 13:33:14.209144 (+1552918us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.216182 7307 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.330451 5618 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:14.330711 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.331540 5618 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:14.332007 7307 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.332403 7419 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.332794 7419 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:14.333132 7419 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.333175 5618 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:14.217024 7528 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:14.210480 5658 raft_consensus.cc:2379] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:14.334537 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 756) took 1908 ms. Trace:
I20260807 13:33:14.180779 7392 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.221487 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 768) took 1027 ms. Trace:
I20260807 13:33:14.213124 7261 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.240571 7483 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.210057 7435 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:14.240080 7179 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.294768 5542 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:14.306886 7502 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.232805 7418 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.316987 5543 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
W20260807 13:33:14.333954 5663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 754) took 1910 ms (client timeout 2251 ms). Trace:
W20260807 13:33:14.322701 5721 connection.cc:232] RPC call timeout handler was delayed by -1.8196738068945706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2279s for a response
I20260807 13:33:13.743464 7316 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.326471 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.212117 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.375620 5662 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:14.327849 7201 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:14.217876 7216 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.336071 5618 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:14.340943 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:14.342375 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.179533 7462 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.182695 7494 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.347383 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.344305 5767 raft_consensus.cc:1226] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:14.343298 7278 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.360347 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 787) took 1069 ms. Trace:
I20260807 13:33:14.367019 7502 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.361876 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:14.307780 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:14.364130 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.391840 5765 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 1.
I20260807 13:33:14.313710 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 771) took 1118 ms. Trace:
I20260807 13:33:14.392719 5545 rpcz_store.cc:276] 0807 13:33:13.194813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.312832 (+1118019us) service_pool.cc:227] Handling call
0807 13:33:14.313147 (+ 315us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.313350 (+ 203us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.313384 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.313433 (+ 49us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:14.313473 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.313537 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.313657 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.394266 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:14.372105 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 101174us
I20260807 13:33:14.346169 7531 raft_consensus.cc:2781] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.395713 7531 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.396245 7531 raft_consensus.cc:3037] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.397575 7464 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.373128 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.335373 7505 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:14.398058 7526 consensus_queue.cc:1035] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260807 13:33:14.346427 7409 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.334928 5658 rpcz_store.cc:276] 0807 13:33:12.425739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.429251 (+ 3512us) service_pool.cc:227] Handling call
0807 13:33:13.094036 (+664785us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:14.334475 (+1240439us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27955968}
I20260807 13:33:14.376694 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.377357 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 784) took 1055 ms. Trace:
I20260807 13:33:14.359668 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.368957 7418 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.317974 7500 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.281705 7510 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.381268 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 769) took 1187 ms. Trace:
W20260807 13:33:14.384343 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 48319.8us
I20260807 13:33:14.226044 7499 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.346328 7517 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:14.389101 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.386647 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.387751 5542 rpcz_store.cc:276] 0807 13:33:13.291297 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.184772 (+893475us) service_pool.cc:227] Handling call
0807 13:33:14.360261 (+175489us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.193529 5389 rpcz_store.cc:276] 0807 13:33:08.497438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.497923 (+ 485us) service_pool.cc:227] Handling call
0807 13:33:14.183843 (+5685920us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:10.110021 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:10.115621 (+ 5600us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:10.115711 (+ 90us) write_op.cc:435] Acquired schema lock
0807 13:33:10.115762 (+ 51us) tablet.cc:660] Decoding operations
0807 13:33:10.116996 (+ 1234us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:10.117113 (+ 117us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:10.117221 (+ 108us) tablet.cc:683] Acquiring locks for 1 operations
0807 13:33:10.117684 (+ 463us) tablet.cc:699] Row locks acquired
0807 13:33:10.117719 (+ 35us) write_op.cc:260] PREPARE: finished
0807 13:33:10.117981 (+ 262us) write_op.cc:270] Start()
0807 13:33:10.126271 (+ 8290us) write_op.cc:276] Timestamp: P: 1786109590117890 usec, L: 0
0807 13:33:10.128660 (+ 2389us) op_driver.cc:331] REPLICATION: starting
0807 13:33:10.195713 (+ 67053us) log.cc:842] Serialized 540 byte log entry
0807 13:33:12.388855 (+2193142us) op_driver.cc:444] REPLICATION: finished
0807 13:33:12.829965 (+441110us) write_op.cc:301] APPLY: starting
0807 13:33:12.855032 (+ 25067us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:12.893063 (+ 38031us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:13.029481 (+136418us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:13.042093 (+ 12612us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:13.147813 (+105720us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 13:33:13.161462 (+ 13649us) write_op.cc:312] APPLY: finished
0807 13:33:13.162008 (+ 546us) log.cc:842] Serialized 22 byte log entry
0807 13:33:13.331425 (+169417us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:13.375276 (+ 43851us) write_op.cc:454] Released schema lock
0807 13:33:13.382257 (+ 6981us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:13.530045 (+147788us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:13.562208 (+ 32163us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40242,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":351525,"apply.run_cpu_time_us":24871,"apply.run_wall_time_us":1334039,"mutex_wait_us":2454,"num_ops":1,"prepare.queue_time_us":185,"prepare.run_cpu_time_us":6668,"prepare.run_wall_time_us":112406,"raft.queue_time_us":746910,"raft.run_cpu_time_us":5866,"raft.run_wall_time_us":75040,"replication_time_us":2260084,"thread_start_us":1070076,"threads_started":3,"wal-append.queue_time_us":200240}]]}
I20260807 13:33:14.399624 7505 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.376557 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.333525 7307 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:14.399696 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 773) took 1204 ms. Trace:
I20260807 13:33:14.481086 6691 raft_consensus.cc:1226] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:14.481350 7517 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:14.481871 7517 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:14.406548 7392 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.373955 7422 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.402788 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.481209 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.490293 5765 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
W20260807 13:33:14.478325 5620 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52574 dropped due to backpressure. The service queue is full; it has 50 items.
I20260807 13:33:14.480870 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.411255 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.400665 5548 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:14.190476 6688 rpcz_store.cc:276] 0807 13:33:10.334315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:10.349710 (+ 15395us) service_pool.cc:227] Handling call
0807 13:33:10.356974 (+ 7264us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:10.357821 (+ 847us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:10.357937 (+ 116us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:10.359227 (+ 1290us) log.cc:842] Serialized 26 byte log entry
0807 13:33:12.034168 (+1674941us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:12.040645 (+ 6477us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:12.049802 (+ 9157us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:13.571291 (+1521489us) raft_consensus.cc:1671] finished
0807 13:33:13.596445 (+ 25154us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:13.616330 (+ 19885us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9533,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":190,"thread_start_us":1636263,"threads_started":1,"wal-append.queue_time_us":1827206}
W20260807 13:33:14.391866 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 48058.5us
I20260807 13:33:14.498754 7499 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.499169 5667 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 1.
I20260807 13:33:14.475502 7490 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:14.504918 7490 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:14.503981 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 120324us
I20260807 13:33:14.388784 7201 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.480870 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.509310 5769 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:14.496364 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 772) took 1301 ms. Trace:
I20260807 13:33:14.484992 5618 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:14.458704 5761 raft_consensus.cc:1226] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:14.484403 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 775) took 2023 ms. Trace:
I20260807 13:33:14.484026 5666 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:14.517159 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 781) took 1244 ms. Trace:
I20260807 13:33:14.516871 5553 rpcz_store.cc:276] 0807 13:33:12.461446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.461601 (+ 155us) service_pool.cc:227] Handling call
0807 13:33:12.461871 (+ 270us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.297332 (+1835461us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.484154 (+186822us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b540016fb54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:14.484360 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3969063168}
I20260807 13:33:14.481156 5555 rpcz_store.cc:276] 0807 13:33:13.194273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.299596 (+1105323us) service_pool.cc:227] Handling call
0807 13:33:14.299928 (+ 332us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:14.300226 (+ 298us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.300263 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:14.300653 (+ 390us) log.cc:842] Serialized 26 byte log entry
0807 13:33:14.373182 (+ 72529us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:14.373217 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.373274 (+ 57us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:14.381060 (+ 7786us) raft_consensus.cc:1671] finished
0807 13:33:14.381080 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.381212 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":997,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":72138,"threads_started":1,"wal-append.queue_time_us":78378}
I20260807 13:33:14.483856 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 774) took 1288 ms. Trace:
I20260807 13:33:14.401647 7494 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.518617 5542 rpcz_store.cc:276] 0807 13:33:13.195652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.483171 (+1287519us) service_pool.cc:227] Handling call
0807 13:33:14.483440 (+ 269us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.483586 (+ 146us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.483608 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.483644 (+ 36us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:14.483670 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.483715 (+ 45us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.483806 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.484107 5543 rpcz_store.cc:276] 0807 13:33:13.195376 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.398814 (+1203438us) service_pool.cc:227] Handling call
0807 13:33:14.399142 (+ 328us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.399336 (+ 194us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.399371 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.399423 (+ 52us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:14.399462 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.399523 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.399634 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.440393 7179 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:14.522233 5553 raft_consensus.cc:1261] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:14.522827 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 775) took 1326 ms. Trace:
I20260807 13:33:14.405542 7482 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.510504 5545 rpcz_store.cc:276] 0807 13:33:13.195111 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.395366 (+1200255us) service_pool.cc:227] Handling call
0807 13:33:14.495819 (+100453us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.496002 (+ 183us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.496035 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.496082 (+ 47us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:14.496120 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.496176 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.496286 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:14.369290 5663 rpcz_store.cc:269] 0807 13:33:12.424475 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.430359 (+ 5884us) service_pool.cc:227] Handling call
0807 13:33:14.333887 (+1903528us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.485741 7435 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.483829 5662 rpcz_store.cc:276] 0807 13:33:13.321579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.211922 (+890343us) service_pool.cc:227] Handling call
0807 13:33:14.377257 (+165335us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.515872 5618 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:14.519379 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 172870us
I20260807 13:33:14.479414 7261 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:14.483103 7409 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:14.517809 5666 rpcz_store.cc:276] 0807 13:33:13.273418 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.241070 (+967652us) service_pool.cc:227] Handling call
0807 13:33:14.386461 (+145391us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:14.517080 (+130619us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":23697280}
I20260807 13:33:14.520661 5721 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.390434 7278 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.523142 5553 rpcz_store.cc:276] 0807 13:33:13.195918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.521648 (+1325730us) service_pool.cc:227] Handling call
0807 13:33:14.521909 (+ 261us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.522612 (+ 703us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.522785 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.484025 5764 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:14.522084 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 776) took 1325 ms. Trace:
I20260807 13:33:14.508800 7201 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:14.534559 5765 raft_consensus.cc:1261] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:14.527031 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.521370 7499 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:14.526787 5545 raft_consensus.cc:1261] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:14.484951 7462 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.532586 6692 raft_consensus.cc:2396] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260807 13:33:14.461978 7444 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.563261 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 791) took 1194 ms. Trace:
I20260807 13:33:14.554450 5555 rpcz_store.cc:276] 0807 13:33:13.196208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.521261 (+1325053us) service_pool.cc:227] Handling call
0807 13:33:14.521549 (+ 288us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.521735 (+ 186us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.521759 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.521793 (+ 34us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:14.521818 (+ 25us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.521881 (+ 63us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.522019 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:14.557479 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 220244us
I20260807 13:33:14.558270 5721 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.558645 7500 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.558745 7278 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.523870 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 790) took 1132 ms. Trace:
I20260807 13:33:14.361120 5544 rpcz_store.cc:276] 0807 13:33:13.193939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.220691 (+1026752us) service_pool.cc:227] Handling call
0807 13:33:14.220905 (+ 214us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.221179 (+ 274us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.221210 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.221252 (+ 42us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:14.221297 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.221358 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.221449 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98}
I20260807 13:33:14.539620 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 785) took 1285 ms. Trace:
I20260807 13:33:14.562606 5553 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260807 13:33:14.653628 5542 rpcz_store.cc:276] 0807 13:33:13.254687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.519687 (+1265000us) service_pool.cc:227] Handling call
0807 13:33:14.539210 (+ 19523us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.539347 (+ 137us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.539371 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.539408 (+ 37us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:14.539433 (+ 25us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.539478 (+ 45us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.539556 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.534518 7306 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:14.531517 7409 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.566498 5545 rpcz_store.cc:276] 0807 13:33:13.368396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.526262 (+1157866us) service_pool.cc:227] Handling call
0807 13:33:14.526504 (+ 242us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.562914 (+ 36410us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.563210 (+ 296us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.530598 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.557250 7201 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.557209 7499 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:14.527870 7510 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.532081 7438 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.524387 7534 consensus_queue.cc:1046] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.004s
I20260807 13:33:14.688721 7418 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.690073 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.690770 7438 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.559674 7261 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.637017 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:14.691736 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 88234.9us
W20260807 13:33:14.638463 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 80280.1us
I20260807 13:33:14.692938 5721 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.495021 5620 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52574 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 40)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 43)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 42)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 780)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 789)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 39)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 41)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1152)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1168)
I20260807 13:33:14.642346 7252 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:14.646523 7444 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.640506 5660 rpcz_store.cc:276] 0807 13:33:13.387647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.225376 (+837729us) service_pool.cc:227] Handling call
0807 13:33:14.519748 (+294372us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2304}
I20260807 13:33:14.647854 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.652511 7502 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.666783 5764 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:33:14.667840 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 121064us
I20260807 13:33:14.636082 7464 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:14.688287 7531 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:14.694056 5721 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.684121 7499 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:14.695402 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.713719 5765 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:14.696727 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:14.715601 5762 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:14.708596 7409 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.710970 5721 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.691299 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:14.717743 5770 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.719269 5721 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.698923 6638 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:14.696511 7261 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.712450 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.696955 7548 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:14.721719 5721 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.712864 7252 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:14.720775 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.734172 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.735186 5662 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:14.727725 7261 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.740779 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.745201 5762 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:14.731846 7435 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.726974 7414 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.728260 7383 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.741350 7455 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.712883 7464 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:14.736353 6688 raft_consensus.cc:1226] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:14.752429 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 786) took 1484 ms. Trace:
I20260807 13:33:14.791024 5543 rpcz_store.cc:276] 0807 13:33:13.267720 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.519829 (+1252109us) service_pool.cc:227] Handling call
0807 13:33:14.520099 (+ 270us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.520256 (+ 157us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:33:14.653492 (+133236us) log.cc:842] Serialized 14 byte log entry
0807 13:33:14.752155 (+ 98663us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.752199 (+ 44us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:14.752234 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.752288 (+ 54us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.752380 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14337,"prepare.queue_time_us":190863,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":4293,"raft.queue_time_us":14888,"thread_start_us":208559,"threads_started":2,"wal-append.queue_time_us":97127}
I20260807 13:33:14.753722 5721 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.785358 5501 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:14.783943 5620 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52574 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 40)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 43)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 42)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 780)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 789)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 39)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 41)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1152)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1163)
I20260807 13:33:14.793277 7528 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:14.754567 5770 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:14.751039 7414 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:14.783030 5725 leader_election.cc:334] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Timed out: RequestConsensusVote RPC to 127.3.187.196:41077 timed out after 1.812s (SENT)
I20260807 13:33:14.795019 5721 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:14.750768 5658 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:14.796281 5725 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:14.741704 7179 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:14.796535 5721 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.795015 6638 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:14.784641 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.796921 5620 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52574 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 40)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 43)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 42)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 780)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 789)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 39)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 41)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1152)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1155)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1156)
I20260807 13:33:14.804507 7517 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.804139 5620 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52574 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 40)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 43)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 42)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 780)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 789)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 39)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 41)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1152)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1155)
I20260807 13:33:14.796151 7528 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:14.807962 7528 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:14.801651 7252 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:14.808593 7528 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:14.811761 5501 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:14.812433 5721 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.812628 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.802376 7409 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.802640 7414 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:14.799847 5499 leader_election.cc:334] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Timed out: RequestConsensusVote RPC to 127.3.187.194:42569 timed out after 1.520s (SENT)
I20260807 13:33:14.749984 7383 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.815323 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.808547 5620 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52574 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1172)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 40)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1179)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 43)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1181)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1182)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1173)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1184)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 42)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 780)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 789)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 39)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 41)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1134)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1150)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1151)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1152)
I20260807 13:33:14.819919 5662 raft_consensus.cc:2379] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:14.820811 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:14.822063 5725 leader_election.cc:334] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077): Timed out: RequestConsensusVote RPC to 127.3.187.196:41077 timed out after 1.820s (SENT)
I20260807 13:33:14.823873 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.824321 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.824481 7418 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.824802 6685 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:14.826406 7383 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.826347 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.827375 5770 raft_consensus.cc:1226] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:14.826340 6696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37838 (request call id 50) took 1179 ms. Trace:
I20260807 13:33:14.828681 6696 rpcz_store.cc:276] 0807 13:33:13.646799 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.825522 (+1178723us) service_pool.cc:227] Handling call
0807 13:33:14.825820 (+ 298us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.825996 (+ 176us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.826023 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:14.826069 (+ 46us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:14.826099 (+ 30us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.826185 (+ 86us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.826284 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.829290 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:14.829790 5665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 758) took 2403 ms (client timeout 1520 ms). Trace:
W20260807 13:33:14.830188 5665 rpcz_store.cc:269] 0807 13:33:12.426667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.426794 (+ 127us) service_pool.cc:227] Handling call
0807 13:33:14.829576 (+2402782us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54002b9dd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:14.829694 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4135814528}
I20260807 13:33:14.830750 5621 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:14.831456 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.748905 7435 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.838698 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 791) took 2177 ms. Trace:
I20260807 13:33:14.839059 5552 rpcz_store.cc:276] 0807 13:33:12.661233 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:13.188108 (+526875us) service_pool.cc:227] Handling call
0807 13:33:13.188370 (+ 262us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:14.121973 (+933603us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.838451 (+716478us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b5400221d54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:14.838631 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2145489152}
I20260807 13:33:14.811012 7179 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.840780 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.841691 5662 raft_consensus.cc:2354] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
I20260807 13:33:14.842541 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.832005 5770 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:14.832841 7418 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.832928 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:14.833189 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:14.845557 5499 leader_election.cc:334] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Timed out: RequestConsensusVote RPC to 127.3.187.194:42569 timed out after 1.577s (SENT)
I20260807 13:33:14.833671 7568 consensus_queue.cc:1035] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 13:33:14.834357 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.834383 5761 raft_consensus.cc:1261] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:14.813985 7505 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:14.843186 5662 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:14.817097 7252 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.848585 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 786) took 1526 ms. Trace:
I20260807 13:33:14.875387 5665 rpcz_store.cc:276] 0807 13:33:13.322191 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.832678 (+1510487us) service_pool.cc:227] Handling call
0807 13:33:14.848521 (+ 15843us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.838884 7455 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:14.850562 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.862247 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:14.808720 7464 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:14.867411 5543 raft_consensus.cc:1261] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:14.881589 5764 raft_consensus.cc:1799] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Handling vote request from an unknown peer 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:14.870357 5620 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:14.845042 7179 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:14.872612 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.857510 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:14.887282 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.878965 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.888217 5553 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:14.883726 5764 raft_consensus.cc:2379] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:14.850147 7548 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.849604 7502 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.855427 7418 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:14.885958 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:14.844038 7435 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.900440 7473 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.865736 7570 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:14.903554 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:14.817469 7419 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.904184 5764 raft_consensus.cc:3037] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.884302 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.884477 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.892853 5620 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:14.893834 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:14.896397 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.892370 7548 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.899063 7531 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.899189 7307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54374 (request call id 647) took 10578 ms. Trace:
I20260807 13:33:14.891062 7505 raft_consensus.cc:686] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:14.880715 7252 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.899456 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.881031 7455 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:14.939076 7455 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:14.939680 7517 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.906010 5620 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:14.910848 7278 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.926723 7502 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:14.915169 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.906030 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:14.911983 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 99588.1us
I20260807 13:33:14.903484 7418 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.919694 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:14.945242 5770 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.945519 5721 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.946388 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 775) took 1685 ms. Trace:
I20260807 13:33:14.947865 5721 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.946748 5659 rpcz_store.cc:276] 0807 13:33:13.261336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:13.261480 (+ 144us) service_pool.cc:227] Handling call
0807 13:33:13.261826 (+ 346us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:14.326460 (+1064634us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.326488 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:14.326939 (+ 451us) log.cc:842] Serialized 26 byte log entry
0807 13:33:14.492069 (+165130us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:14.492139 (+ 70us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.945866 (+453727us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000e47d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:14.945920 (+ 54us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:14.945970 (+ 50us) raft_consensus.cc:1671] finished
0807 13:33:14.945984 (+ 14us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.946320 (+ 336us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2162,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":128,"spinlock_wait_cycles":2447652096,"thread_start_us":164748,"threads_started":1,"wal-append.queue_time_us":154533}
I20260807 13:33:14.948556 7578 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.948940 7578 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:14.949286 7578 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.949149 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.890661 7306 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:14.922086 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.922403 7339 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.929945 5764 raft_consensus.cc:2454] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:14.902412 7570 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:14.966899 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.967456 7570 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:14.968662 5667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 788) took 1591 ms (client timeout 1676 ms). Trace:
W20260807 13:33:14.968997 5667 rpcz_store.cc:269] 0807 13:33:13.374919 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.211746 (+836827us) service_pool.cc:227] Handling call
0807 13:33:14.965956 (+754210us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540026d9d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:14.966053 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":658858752}
I20260807 13:33:14.935792 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.934815 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:14.922616 7548 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.944551 5620 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:14.950773 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.971973 5620 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:14.951718 5721 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.949934 5659 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:14.952513 6638 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:14.973567 5620 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.952669 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.954094 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:14.975530 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:14.976418 5542 raft_consensus.cc:2354] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:14.977470 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:14.978314 7531 raft_consensus.cc:2781] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:14.970969 7502 consensus_queue.cc:1035] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260807 13:33:14.979275 7531 raft_consensus.cc:686] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:14.954620 7444 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:14.955142 7456 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.958304 7426 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:14.983229 7426 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:14.958735 6687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57212 (request call id 94) took 2149 ms (client timeout 2124 ms). Trace:
I20260807 13:33:14.962899 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:14.936139 7252 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.924804 7201 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.963099 7261 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:14.953351 5543 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:14.994530 7368 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260807 13:33:14.965157 5548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 785) took 2305 ms (client timeout 2234 ms). Trace:
W20260807 13:33:15.022917 5548 rpcz_store.cc:269] 0807 13:33:12.659646 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:13.180628 (+520982us) service_pool.cc:227] Handling call
0807 13:33:14.964950 (+1784322us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400000d54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:14.965080 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2761685760}
I20260807 13:33:15.023309 7261 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:15.024017 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:15.024657 5548 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:15.025490 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:15.026379 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:15.027004 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:15.029410 7390 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:14.994537 6687 rpcz_store.cc:269] 0807 13:33:12.835734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.838125 (+ 2391us) service_pool.cc:227] Handling call
0807 13:33:14.899192 (+2061067us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b5800005498. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:14.958590 (+ 59398us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13631872}
I20260807 13:33:15.031244 5548 raft_consensus.cc:1226] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:14.965937 5770 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:15.035425 5618 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:14.965787 7505 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.036875 5618 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:15.038269 7368 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:15.038157 7502 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:15.038570 7444 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:15.038767 7368 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:15.039358 7368 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:15.041071 7510 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:15.041654 7510 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:15.042333 7510 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:14.969884 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.970201 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 771) took 1717 ms. Trace:
I20260807 13:33:15.047333 5661 rpcz_store.cc:276] 0807 13:33:13.252698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:13.252925 (+ 227us) service_pool.cc:227] Handling call
0807 13:33:13.253268 (+ 343us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:14.441375 (+1188107us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:14.441405 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:14.441800 (+ 395us) log.cc:842] Serialized 26 byte log entry
0807 13:33:14.596459 (+154659us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:14.596511 (+ 52us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:14.945109 (+348598us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540024d1d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:14.945150 (+ 41us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:14.945191 (+ 41us) raft_consensus.cc:1671] finished
0807 13:33:14.945205 (+ 14us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:14.970138 (+ 24933us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":457,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":2731638144,"thread_start_us":102367,"threads_started":1,"wal-append.queue_time_us":178062}
I20260807 13:33:14.981040 7531 consensus_queue.cc:237] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:14.989502 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.985479 5721 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:14.985447 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:14.928169 7307 rpcz_store.cc:276] 0807 13:33:04.320556 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:04.320722 (+ 166us) service_pool.cc:227] Handling call
0807 13:33:04.395273 (+ 74551us) log.cc:842] Serialized 501 byte log entry
0807 13:33:04.823481 (+428208us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b18002910a0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f41bf96 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682307a4f 00007ff6822f0545 00007ff6822f5771
0807 13:33:04.825017 (+ 1536us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b5400387fa0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682307a4f 00007ff6822f0545 00007ff6822f5771 00007ff6822f56f9 00007ff6822f5689 00007ff6822f5651 00007ff6822f481d 00007ff6886b2204 00007ff6886b2039 00007ff67f44e6b6
0807 13:33:04.832655 (+ 7638us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5400387fa0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682304771 00007ff68230f220 00007ff68230f1c8 00007ff68230f148 00007ff68230f103 00007ff68230e38c 00007ff68837f206 00007ff688377808 00007ff68234b38b 00007ff68234de80
0807 13:33:14.899012 (+10066357us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16945,"raft.queue_time_us":16299,"raft.run_cpu_time_us":6866,"raft.run_wall_time_us":320650,"spinlock_wait_cycles":23003392,"thread_start_us":196182,"threads_started":1,"wal-append.queue_time_us":198872,"wal-append.run_cpu_time_us":8861,"wal-append.run_wall_time_us":1239120}
I20260807 13:33:14.997771 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:14.999610 5620 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:14.994912 7373 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 13:33:15.060243 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 60677.1us
I20260807 13:33:14.994307 7383 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.000430 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:14.971009 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.062613 7307 raft_consensus.cc:3032] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:15.062768 7383 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:14.989885 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.063171 7307 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:15.063519 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.064848 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.064298 7307 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.065490 5663 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:15.001725 7201 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.071998 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.071426 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.004129 7316 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.982327 7517 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:15.005357 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.097000 5660 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:15.098320 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:15.008059 5656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 763) took 2556 ms (client timeout 2007 ms). Trace:
W20260807 13:33:15.099128 5656 rpcz_store.cc:269] 0807 13:33:12.451374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:12.457323 (+ 5949us) service_pool.cc:227] Handling call
0807 13:33:15.007703 (+2550380us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b540007dfd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:15.007933 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":103289728}
I20260807 13:33:15.099793 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.100168 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.100960 5656 raft_consensus.cc:2379] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:15.101302 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.101694 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:15.010637 6636 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:14.983814 7426 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:15.010972 7179 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.108143 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.109503 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:14.984612 7409 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:15.012801 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.112792 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:15.112974 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 102549us
I20260807 13:33:15.102330 5656 raft_consensus.cc:2362] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3. Re-sending same reply.
I20260807 13:33:15.113374 5666 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:15.014887 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:15.007078 5556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 765) took 1814 ms (client timeout 2021 ms). Trace:
I20260807 13:33:15.007043 5390 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36640 (request call id 65) took 6840 ms. Trace:
I20260807 13:33:15.084652 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:15.483103 5545 raft_consensus.cc:2379] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:15.066936 5618 leader_election.cc:398] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:15.080142 5658 raft_consensus.cc:2379] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:15.022356 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:15.118245 5556 rpcz_store.cc:269] 0807 13:33:13.193026 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:13.198185 (+ 5159us) service_pool.cc:227] Handling call
0807 13:33:15.006855 (+1808670us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54002b1954. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:15.006995 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2284847872}
I20260807 13:33:15.082232 5555 raft_consensus.cc:1261] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:15.095624 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.110484 5660 raft_consensus.cc:2354] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
W20260807 13:33:15.057849 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 72450.7us
I20260807 13:33:15.049484 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.645561 5661 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:15.124109 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:15.057667 5662 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:15.114189 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:15.652241 5666 raft_consensus.cc:2354] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
I20260807 13:33:15.652719 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1148) took 1280 ms. Trace:
I20260807 13:33:15.653038 5666 rpcz_store.cc:276] 0807 13:33:14.372678 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.113967 (+741289us) service_pool.cc:227] Handling call
0807 13:33:15.652656 (+538689us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:14.964360 5722 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:15.143551 6637 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:15.659885 7531 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:15.660315 7531 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:15.660389 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 516791us
I20260807 13:33:15.660781 7531 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:15.187397 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.079493 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.054123 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.669158 6687 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260807 13:33:15.669602 6687 pending_rounds.cc:76] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Aborting all ops after (but not including) 4
I20260807 13:33:15.137271 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.309873 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.073622 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.123075 6694 raft_consensus.cc:1799] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Handling vote request from an unknown peer 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:15.081224 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.130508 7114 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:15.070739 7142 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:15.688841 7142 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:15.689483 7142 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:15.110206 7179 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:14.991396 7278 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.058997 7289 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:15.694324 7289 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:15.694857 7289 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:15.065759 7307 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:15.068789 7368 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.701859 5659 raft_consensus.cc:2379] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:15.021147 7414 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.707026 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.707890 5662 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:15.708293 7414 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:15.048877 7418 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.709717 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1146) took 1338 ms. Trace:
I20260807 13:33:15.710088 5661 rpcz_store.cc:276] 0807 13:33:14.371429 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.049161 (+677732us) service_pool.cc:227] Handling call
0807 13:33:15.709622 (+660461us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.711302 7418 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:15.080291 7422 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:15.713060 7422 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:15.713507 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 748962us
I20260807 13:33:15.714982 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.114009 7430 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:15.082293 7435 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.160267 7455 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.720108 7435 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.720754 7455 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:14.994820 7499 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.723265 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:15.724195 7499 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:15.716485 7430 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:15.155799 7510 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.155030 7528 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.728397 7510 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.729458 5665 raft_consensus.cc:2379] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:15.122913 7490 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.139446 7548 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.017169 7570 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.133210 7578 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.740597 7570 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.740815 7578 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:15.316515 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:15.741992 5666 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:15.189338 5394 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51200 (request call id 189) took 4351 ms. Trace:
I20260807 13:33:15.744372 5394 rpcz_store.cc:276] 0807 13:33:10.838597 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:10.839156 (+ 559us) service_pool.cc:227] Handling call
0807 13:33:15.189273 (+4350117us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:13.045685 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:13.069216 (+ 23531us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:13.069258 (+ 42us) write_op.cc:435] Acquired schema lock
0807 13:33:13.069277 (+ 19us) tablet.cc:660] Decoding operations
0807 13:33:13.069870 (+ 593us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:13.069937 (+ 67us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:13.069975 (+ 38us) tablet.cc:683] Acquiring locks for 2 operations
0807 13:33:13.070308 (+ 333us) tablet.cc:699] Row locks acquired
0807 13:33:13.070328 (+ 20us) write_op.cc:260] PREPARE: finished
0807 13:33:13.070490 (+ 162us) write_op.cc:270] Start()
0807 13:33:13.070636 (+ 146us) write_op.cc:276] Timestamp: P: 1786109593070442 usec, L: 0
0807 13:33:13.070674 (+ 38us) op_driver.cc:331] REPLICATION: starting
0807 13:33:13.263278 (+192604us) log.cc:842] Serialized 1169 byte log entry
0807 13:33:14.120603 (+857325us) op_driver.cc:444] REPLICATION: finished
0807 13:33:14.196894 (+ 76291us) write_op.cc:301] APPLY: starting
0807 13:33:14.199859 (+ 2965us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:14.215618 (+ 15759us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:14.228836 (+ 13218us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:14.308261 (+ 79425us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:14.348595 (+ 40334us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 13:33:14.365421 (+ 16826us) write_op.cc:312] APPLY: finished
0807 13:33:14.386090 (+ 20669us) log.cc:842] Serialized 28 byte log entry
0807 13:33:14.408947 (+ 22857us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:14.442175 (+ 33228us) write_op.cc:454] Released schema lock
0807 13:33:14.463153 (+ 20978us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:14.486106 (+ 22953us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:14.486159 (+ 53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":699297,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":61857,"apply.run_cpu_time_us":2877,"apply.run_wall_time_us":291408,"num_ops":2,"prepare.queue_time_us":1030551,"prepare.run_cpu_time_us":3805,"prepare.run_wall_time_us":322545,"replication_time_us":1049821,"thread_start_us":400711,"threads_started":2}]]}
I20260807 13:33:15.407264 5372 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c61e1dd5b00c43d2a1747f4832ac333c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:33:15.437860 7572 consensus_queue.cc:1046] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260807 13:33:15.749293 5372 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 342446us
I20260807 13:33:15.749732 7572 raft_consensus.cc:3032] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:15.750191 7572 raft_consensus.cc:729] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:15.751904 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1173) took 1023 ms. Trace:
W20260807 13:33:15.455892 5501 leader_election.cc:334] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Timed out: RequestConsensusVote RPC to 127.3.187.195:43427 timed out after 1.520s (SENT)
I20260807 13:33:15.753846 5501 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:15.140178 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.755861 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1153) took 1377 ms. Trace:
I20260807 13:33:15.756271 5656 rpcz_store.cc:276] 0807 13:33:14.378234 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.121283 (+743049us) service_pool.cc:227] Handling call
0807 13:33:15.755649 (+634366us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.078547 5620 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:15.478628 5390 rpcz_store.cc:276] 0807 13:33:08.166368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:08.166574 (+ 206us) service_pool.cc:227] Handling call
0807 13:33:15.006976 (+6840402us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:08.941714 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:09.535439 (+593725us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:09.535512 (+ 73us) write_op.cc:435] Acquired schema lock
0807 13:33:09.535539 (+ 27us) tablet.cc:660] Decoding operations
0807 13:33:09.536449 (+ 910us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:09.536596 (+ 147us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:09.536674 (+ 78us) tablet.cc:683] Acquiring locks for 1 operations
0807 13:33:09.537142 (+ 468us) tablet.cc:699] Row locks acquired
0807 13:33:09.537159 (+ 17us) write_op.cc:260] PREPARE: finished
0807 13:33:09.537577 (+ 418us) write_op.cc:270] Start()
0807 13:33:09.537848 (+ 271us) write_op.cc:276] Timestamp: P: 1786109589537481 usec, L: 0
0807 13:33:09.537904 (+ 56us) op_driver.cc:331] REPLICATION: starting
0807 13:33:09.707035 (+169131us) log.cc:842] Serialized 535 byte log entry
0807 13:33:10.922374 (+1215339us) op_driver.cc:444] REPLICATION: finished
0807 13:33:11.736155 (+813781us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff67f4305fe 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff685d86410
0807 13:33:13.115718 (+1379563us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5400002728. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff688897e91 00007ff688896afc 00007ff685d86cb5 00007ff685d8add1 00007ff685d8ad89 00007ff685d8ad19 00007ff685d8ace1 00007ff685d89fdd 00007ff6886b2204 00007ff6886b2039 00007ff67f44e6b6
0807 13:33:13.211749 (+ 96031us) write_op.cc:301] APPLY: starting
0807 13:33:13.243127 (+ 31378us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:13.257028 (+ 13901us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:13.268949 (+ 11921us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:13.383794 (+114845us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:13.481476 (+ 97682us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 13:33:13.528706 (+ 47230us) write_op.cc:312] APPLY: finished
0807 13:33:13.643427 (+114721us) log.cc:842] Serialized 22 byte log entry
0807 13:33:13.643655 (+ 228us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:13.643749 (+ 94us) write_op.cc:454] Released schema lock
0807 13:33:13.643800 (+ 51us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:13.644091 (+ 291us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:13.644127 (+ 36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":872463,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1612466,"apply.run_cpu_time_us":27126,"apply.run_wall_time_us":1486986,"num_ops":1,"prepare.queue_time_us":260460,"prepare.run_cpu_time_us":21819,"prepare.run_wall_time_us":931798,"raft.queue_time_us":2956219,"raft.run_cpu_time_us":62028,"raft.run_wall_time_us":1704731,"replication_time_us":1361823,"spinlock_wait_cycles":118456320,"thread_start_us":1922184,"threads_started":4,"wal-append.queue_time_us":182279,"wal-append.run_cpu_time_us":38411,"wal-append.run_wall_time_us":1510098}]]}
W20260807 13:33:15.578780 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 529671us
I20260807 13:33:15.591738 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1159) took 1211 ms. Trace:
I20260807 13:33:15.597500 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:15.760922 7510 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:15.603307 5764 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:15.761468 7510 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:15.611773 5771 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 13:33:15.761961 7510 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:15.630074 7419 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.760665 5658 rpcz_store.cc:276] 0807 13:33:14.379734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.050683 (+670949us) service_pool.cc:227] Handling call
0807 13:33:15.591458 (+540775us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.642700 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1149) took 1269 ms. Trace:
I20260807 13:33:15.765085 5660 rpcz_store.cc:276] 0807 13:33:14.372922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.109293 (+736371us) service_pool.cc:227] Handling call
0807 13:33:15.642480 (+533187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.765719 7490 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:15.766454 5660 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:15.643316 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.767884 7490 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:15.768240 5663 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:15.768862 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1169) took 1291 ms. Trace:
I20260807 13:33:15.769209 5663 rpcz_store.cc:276] 0807 13:33:14.477181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.642608 (+1165427us) service_pool.cc:227] Handling call
0807 13:33:15.768807 (+126199us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.658123 7526 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:15.770282 7526 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:15.770756 7526 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:15.771436 5666 rpcz_store.cc:276] 0807 13:33:14.728773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.653968 (+925195us) service_pool.cc:227] Handling call
0807 13:33:15.751810 (+ 97842us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.680907 6681 raft_consensus.cc:1226] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:15.772966 5666 raft_consensus.cc:1226] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:15.774796 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 776) took 2513 ms. Trace:
I20260807 13:33:15.775314 5656 rpcz_store.cc:276] 0807 13:33:13.261698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.757153 (+2495455us) service_pool.cc:227] Handling call
0807 13:33:15.757818 (+ 665us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.774267 (+ 16449us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:15.774314 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:15.774393 (+ 79us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:15.774444 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.774537 (+ 93us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:15.774713 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.777365 5656 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:15.778627 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 787) took 2416 ms. Trace:
I20260807 13:33:15.779035 5663 rpcz_store.cc:276] 0807 13:33:13.361926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.770013 (+2408087us) service_pool.cc:227] Handling call
0807 13:33:15.777851 (+ 7838us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.778232 (+ 381us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:15.778268 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:15.778340 (+ 72us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:15.778387 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.778451 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:15.778559 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.781323 7570 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:15.783807 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 41) took 1577 ms. Trace:
I20260807 13:33:15.715286 5667 raft_consensus.cc:2379] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:15.800776 5663 rpcz_store.cc:276] 0807 13:33:14.206793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.781418 (+1574625us) service_pool.cc:227] Handling call
0807 13:33:15.783105 (+ 1687us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.783417 (+ 312us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:15.783448 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:15.783507 (+ 59us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:15.783547 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.783607 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:15.783727 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.801714 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 43) took 1342 ms. Trace:
I20260807 13:33:15.802091 5667 rpcz_store.cc:276] 0807 13:33:14.459603 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.969660 (+510057us) service_pool.cc:227] Handling call
0807 13:33:15.801516 (+831856us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54002d1254. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:15.801648 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1541068544}
I20260807 13:33:15.802824 7548 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:15.664513 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:15.804116 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1134) took 1448 ms. Trace:
I20260807 13:33:15.134280 7426 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.805666 7368 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:15.806371 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 350603us
I20260807 13:33:15.806432 5663 raft_consensus.cc:1226] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
W20260807 13:33:15.807826 5501 leader_election.cc:334] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Timed out: RequestConsensusVote RPC to 127.3.187.195:43427 timed out after 1.577s (SENT)
I20260807 13:33:15.808393 5501 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:15.807405 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1137) took 1450 ms. Trace:
I20260807 13:33:15.716524 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.810302 5663 rpcz_store.cc:276] 0807 13:33:14.356868 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.805575 (+1448707us) service_pool.cc:227] Handling call
0807 13:33:15.806067 (+ 492us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.807087 (+ 1020us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.807348 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.810972 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1166) took 1371 ms. Trace:
I20260807 13:33:15.811427 5659 rpcz_store.cc:276] 0807 13:33:14.439899 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.716116 (+1276217us) service_pool.cc:227] Handling call
0807 13:33:15.810914 (+ 94798us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.725214 5552 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:15.816174 7526 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.817224 7426 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:15.817589 7526 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:15.725679 7430 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:15.669975 6687 pending_rounds.cc:97] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260807 13:33:15.818631 6687 raft_consensus.cc:2866] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:15.818696 5663 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:15.819466 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1138) took 1462 ms. Trace:
I20260807 13:33:15.711196 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.819811 5663 rpcz_store.cc:276] 0807 13:33:14.357188 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.811290 (+1454102us) service_pool.cc:227] Handling call
0807 13:33:15.818419 (+ 7129us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.819229 (+ 810us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.819418 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.820375 5661 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:15.820936 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 42) took 1570 ms. Trace:
I20260807 13:33:14.905628 7438 consensus_queue.cc:1046] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260807 13:33:15.830049 7510 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.831487 5663 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:15.832748 7510 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:15.730767 5665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1154) took 1352 ms (client timeout 1776 ms). Trace:
I20260807 13:33:15.742509 5554 raft_consensus.cc:1226] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:15.131350 7252 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.725210 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:15.834030 5665 rpcz_store.cc:269] 0807 13:33:14.378459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:14.886995 (+508536us) service_pool.cc:227] Handling call
0807 13:33:15.730496 (+843501us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b54000cec54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:15.730706 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1933859072}
I20260807 13:33:15.838061 5659 raft_consensus.cc:1226] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:15.729494 7528 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:15.751533 7572 consensus_queue.cc:260] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:15.445434 5499 leader_election.cc:334] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Timed out: RequestConsensusVote RPC to 127.3.187.194:42569 timed out after 2.145s (SENT)
I20260807 13:33:15.783857 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
W20260807 13:33:15.794945 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 133411us
W20260807 13:33:15.795656 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 716978us
I20260807 13:33:15.798727 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 777) took 2536 ms. Trace:
I20260807 13:33:15.767652 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 780) took 2494 ms. Trace:
I20260807 13:33:15.866266 5660 rpcz_store.cc:276] 0807 13:33:13.272893 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.765809 (+2492916us) service_pool.cc:227] Handling call
0807 13:33:15.766178 (+ 369us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.767372 (+ 1194us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.767557 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.847062 5770 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:15.868790 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1145) took 1497 ms. Trace:
I20260807 13:33:15.851601 5665 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 13:33:15.708976 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.800251 5618 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:15.804795 6636 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:15.821237 5661 rpcz_store.cc:276] 0807 13:33:14.251031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.710787 (+1459756us) service_pool.cc:227] Handling call
0807 13:33:15.820874 (+110087us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.833212 7430 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.823462 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 789) took 2441 ms. Trace:
I20260807 13:33:15.826802 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:15.821897 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 39) took 1575 ms. Trace:
I20260807 13:33:15.857931 7572 raft_consensus.cc:3037] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:15.860584 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 415410us
I20260807 13:33:15.885356 5666 rpcz_store.cc:276] 0807 13:33:13.381988 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.772130 (+2390142us) service_pool.cc:227] Handling call
0807 13:33:15.772657 (+ 527us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.773410 (+ 753us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.823400 (+ 49990us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.860708 7422 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.862749 7578 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:15.863265 6680 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:15.853586 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1140) took 1495 ms. Trace:
I20260807 13:33:15.804498 5667 rpcz_store.cc:276] 0807 13:33:14.355986 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.802971 (+1446985us) service_pool.cc:227] Handling call
0807 13:33:15.803451 (+ 480us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.803805 (+ 354us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:15.803828 (+ 23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:15.803886 (+ 58us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:15.803913 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.803969 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:15.804067 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.869297 5660 rpcz_store.cc:276] 0807 13:33:14.371189 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.867343 (+1496154us) service_pool.cc:227] Handling call
0807 13:33:15.867901 (+ 558us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.868313 (+ 412us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:15.868351 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:15.868427 (+ 76us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:15.868493 (+ 66us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.868586 (+ 93us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:15.868726 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.873071 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1184) took 1065 ms. Trace:
I20260807 13:33:15.873433 7510 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 13:33:15.874439 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 69949.3us
W20260807 13:33:15.875206 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 75079.3us
I20260807 13:33:15.875862 7435 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:15.875918 7438 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:15.865499 5658 rpcz_store.cc:276] 0807 13:33:13.262013 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.763515 (+2501502us) service_pool.cc:227] Handling call
0807 13:33:15.763950 (+ 435us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.798360 (+ 34410us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:15.798397 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:15.798440 (+ 43us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:15.798479 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.798538 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:15.798644 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.893644 5618 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:15.878050 7418 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:15.879081 5620 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:15.885843 5656 rpcz_store.cc:276] 0807 13:33:14.202963 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.776649 (+1573686us) service_pool.cc:227] Handling call
0807 13:33:15.777092 (+ 443us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.777801 (+ 709us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.778044 (+ 243us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.902837 5620 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:15.903189 6688 raft_consensus.cc:1226] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:15.903359 7418 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:15.903846 7418 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:15.904145 5620 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:15.905918 7499 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:15.906527 5620 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:15.906744 7499 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:15.874600 7306 consensus_queue.cc:1046] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260807 13:33:15.904245 5725 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:15.907649 7278 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:15.908321 7490 consensus_queue.cc:1046] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:15.908522 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:15.908619 5725 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:15.908833 7306 raft_consensus.cc:3032] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:15.871783 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1144) took 1501 ms. Trace:
I20260807 13:33:15.909210 7306 raft_consensus.cc:729] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:15.889945 5662 rpcz_store.cc:276] 0807 13:33:14.808102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.708576 (+900474us) service_pool.cc:227] Handling call
0807 13:33:15.872960 (+164384us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.910403 7306 consensus_queue.cc:260] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.895447 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1152) took 1517 ms. Trace:
I20260807 13:33:15.911326 5667 rpcz_store.cc:276] 0807 13:33:14.377965 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.894388 (+1516423us) service_pool.cc:227] Handling call
0807 13:33:15.894770 (+ 382us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.895062 (+ 292us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:15.895091 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:15.895152 (+ 61us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:15.895184 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.895250 (+ 66us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:15.895381 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.893970 7422 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:15.896940 7419 raft_consensus.cc:3032] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:15.895927 7438 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:15.912534 7419 raft_consensus.cc:729] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:15.912755 7438 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:15.913623 7419 consensus_queue.cc:260] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.915235 7373 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:15.915613 7419 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:15.916103 7373 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:15.877813 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1150) took 1500 ms. Trace:
I20260807 13:33:15.849045 7289 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.918246 5661 rpcz_store.cc:276] 0807 13:33:14.377450 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.871058 (+1493608us) service_pool.cc:227] Handling call
0807 13:33:15.872986 (+ 1928us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.877296 (+ 4310us) raft_consensus.cc:1520] Early marking committed up to index 1
0807 13:33:15.877341 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:15.877421 (+ 80us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:15.877497 (+ 76us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.877583 (+ 86us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:15.877725 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3773,"raft.queue_time_us":4406,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121}
I20260807 13:33:15.899662 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:15.909230 5658 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:15.899277 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1141) took 1531 ms. Trace:
I20260807 13:33:15.919934 7289 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:15.904247 7418 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:15.920265 5663 rpcz_store.cc:276] 0807 13:33:14.368404 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.820646 (+1452242us) service_pool.cc:227] Handling call
0807 13:33:15.821013 (+ 367us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.831943 (+ 10930us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.884922 (+ 52979us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54000ce254. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:15.899190 (+ 14268us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":23571200}
I20260807 13:33:15.909462 5665 rpcz_store.cc:276] 0807 13:33:14.370620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.850785 (+1480165us) service_pool.cc:227] Handling call
0807 13:33:15.851165 (+ 380us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.869476 (+ 18311us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.871711 (+ 2235us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.910856 7499 raft_consensus.cc:686] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:15.889623 5659 rpcz_store.cc:276] 0807 13:33:14.357780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.812057 (+1454277us) service_pool.cc:227] Handling call
0807 13:33:15.837642 (+ 25585us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:15.837856 (+ 214us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.853374 (+ 15518us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.853539 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20837120}
I20260807 13:33:15.926003 7510 consensus_queue.cc:1046] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:15.926192 7499 consensus_queue.cc:237] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.927313 7278 raft_consensus.cc:3032] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:15.927676 7278 raft_consensus.cc:729] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:15.928653 7278 consensus_queue.cc:260] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.919341 7422 consensus_queue.cc:1046] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260807 13:33:15.900887 7430 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:15.930002 7422 raft_consensus.cc:3032] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:15.930413 7422 raft_consensus.cc:729] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:15.930680 7435 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:15.900756 7114 consensus_queue.cc:1046] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:15.931362 7422 consensus_queue.cc:260] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.931973 7114 raft_consensus.cc:3032] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:15.932433 7114 raft_consensus.cc:729] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:15.932548 7368 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:15.932735 7422 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:15.932997 7368 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:15.933549 7368 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:15.853803 7142 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.919100 7306 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:15.933724 5618 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:15.935966 7523 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:15.939100 7142 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.933671 7114 consensus_queue.cc:260] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.939673 5618 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:15.940101 7114 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:15.923295 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1151) took 1545 ms. Trace:
I20260807 13:33:15.942425 7524 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:15.942308 5666 rpcz_store.cc:276] 0807 13:33:14.377728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:15.887618 (+1509890us) service_pool.cc:227] Handling call
0807 13:33:15.922723 (+ 35105us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:15.922988 (+ 265us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:15.923012 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:15.923064 (+ 52us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:15.923090 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:15.923138 (+ 48us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:15.923248 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:15.941895 7278 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:15.944415 5620 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:15.945544 7523 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:15.947464 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.851707 7570 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:15.846721 7252 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:15.956341 7289 consensus_queue.cc:1035] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:15.956923 7368 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.958354 7438 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:15.960476 7438 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.961158 7524 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:15.961938 7368 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:15.950333 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:15.945717 5620 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:15.969691 5663 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:15.963840 5658 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:15.972843 6636 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:15.973619 7435 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:15.974190 7435 raft_consensus.cc:686] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:15.975081 7435 consensus_queue.cc:237] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:15.978296 5725 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:15.984077 5765 raft_consensus.cc:1226] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:15.993763 5770 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:15.998493 5658 raft_consensus.cc:1261] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:16.004024 7368 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:16.018015 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.018191 5659 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:16.002573 7289 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:16.018050 7368 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:16.023798 5666 raft_consensus.cc:2362] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 3. Re-sending same reply.
I20260807 13:33:16.024174 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:16.029251 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 83665.1us
I20260807 13:33:16.029626 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:16.029992 5620 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:16.030772 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 120759us
I20260807 13:33:16.031337 7524 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:16.031405 6638 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:16.025651 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.025734 5659 raft_consensus.cc:2379] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.020074 7572 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:16.015566 7435 consensus_queue.cc:1046] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260807 13:33:16.024760 7368 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:16.049379 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:16.050379 5501 leader_election.cc:334] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427): Timed out: RequestConsensusVote RPC to 127.3.187.195:43427 timed out after 2.027s (SENT)
I20260807 13:33:16.052452 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.052667 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.053030 5554 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:16.053231 5552 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:16.054363 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.055019 7531 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:16.056932 7531 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:16.057916 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.054376 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.060446 7430 raft_consensus.cc:3032] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:16.060915 7430 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:16.073436 5556 raft_consensus.cc:2454] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:16.073726 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.074149 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.074541 5659 raft_consensus.cc:2379] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.074992 5543 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:16.072988 5555 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:16.069787 7289 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260807 13:33:16.088668 5663 raft_consensus.cc:1226] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:16.098758 7435 raft_consensus.cc:3032] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:16.099256 7435 raft_consensus.cc:729] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:16.100273 7435 consensus_queue.cc:260] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:16.038241 7490 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader election won for term 2
W20260807 13:33:16.107663 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 335798us
I20260807 13:33:16.109899 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.111650 5620 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:16.102010 7435 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:16.040818 7572 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.123435 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.115967 7289 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:16.115811 7490 raft_consensus.cc:686] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:16.129628 7278 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:16.061967 7430 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:16.131634 7278 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.132929 5543 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 13:33:16.134140 7490 consensus_queue.cc:237] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:16.122627 7499 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:16.143760 7572 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:16.144091 7430 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:16.144475 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.146291 7289 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.148312 7289 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:16.120952 7418 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.153178 5553 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:16.156127 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.163471 5555 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
W20260807 13:33:16.161732 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 50176.1us
I20260807 13:33:16.164263 5659 raft_consensus.cc:1226] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.177309 6637 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:16.177680 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.179134 5553 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:16.180657 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.180286 5764 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:16.182948 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.172030 5663 raft_consensus.cc:1226] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.185042 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.185065 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.166631 7418 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:16.188879 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.190893 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.192414 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.193400 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.195820 7597 raft_consensus.cc:2932] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:16.199020 7418 consensus_queue.cc:1035] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:16.199257 5620 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:16.200373 5620 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:16.200745 7418 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:16.201377 7418 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:16.203182 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.203822 5771 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:16.203182 6637 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:16.207504 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.207767 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.207990 7490 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:16.208220 5659 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.208691 7490 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:16.209672 5761 raft_consensus.cc:1261] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:16.210486 5666 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:16.211596 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.213846 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.214588 5661 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.215121 5665 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:16.216820 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.217494 5766 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:16.218492 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.218596 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.191764 7278 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:16.219167 5766 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 1.
I20260807 13:33:16.219926 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.220060 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.221112 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.221254 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.219321 5762 raft_consensus.cc:2379] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.201857 7418 raft_consensus.cc:686] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:16.222339 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.223616 5770 raft_consensus.cc:2379] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.223117 7418 consensus_queue.cc:237] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.194567 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:16.224853 5499 leader_election.cc:334] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Timed out: RequestConsensusVote RPC to 127.3.187.194:42569 timed out after 2.977s (SENT)
I20260807 13:33:16.226437 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.227250 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.227897 5762 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:16.228106 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.228392 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.228961 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.229164 5770 raft_consensus.cc:2379] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.229799 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.230433 5766 raft_consensus.cc:1226] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:16.232303 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.232623 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.232900 5767 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:16.234632 5766 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.238461 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.241787 5771 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:16.243145 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.242470 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.243858 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.246239 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.247125 5770 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.248064 5763 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.254920 5618 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:16.256973 7524 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:16.257795 7524 consensus_queue.cc:1035] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:16.269450 5556 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 13:33:16.272009 7368 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.274966 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.277532 5543 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:16.283648 5499 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:16.284826 7572 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:16.285310 7572 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:16.285719 7572 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:16.295933 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.297917 7368 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:16.300757 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.303213 5763 raft_consensus.cc:1226] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.303196 5770 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:16.304288 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.304925 5765 raft_consensus.cc:1226] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
W20260807 13:33:16.302198 7595 log.cc:924] Time spent T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.113s user 0.000s sys 0.000s
I20260807 13:33:16.306094 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:16.307737 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 47825.2us
I20260807 13:33:16.309060 7524 consensus_queue.cc:1046] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:16.308743 7578 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:16.310282 7278 raft_consensus.cc:3032] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:16.310796 7278 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:16.310489 6680 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:16.311856 7278 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.314178 7524 consensus_queue.cc:1046] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:16.315888 7499 raft_consensus.cc:3032] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:16.316341 7499 raft_consensus.cc:729] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:16.317323 7499 consensus_queue.cc:260] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.319041 7278 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:16.335335 7499 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:16.340893 6680 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.342465 7426 consensus_queue.cc:1046] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:16.343519 7426 raft_consensus.cc:3032] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:16.343859 7426 raft_consensus.cc:729] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:16.344892 5697 debug-util.cc:398] Leaking SignalData structure 0x7b08001651e0 after lost signal to thread 3828
I20260807 13:33:16.344743 7426 consensus_queue.cc:260] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:16.346210 5697 debug-util.cc:398] Leaking SignalData structure 0x7b08001658c0 after lost signal to thread 5446
W20260807 13:33:16.347676 5697 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5460 after lost signal to thread 5594
I20260807 13:33:16.347657 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.348388 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.348610 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.345991 7426 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:16.357023 5771 raft_consensus.cc:1226] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.375636 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.325796 5394 catalog_manager.cc:5495] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index 3 to 4, term changed from 3 to 4, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to <none>, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted, no longer has a pending config: VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193), VOTER 737c581af06a42df94970a1542600159 (127.3.187.195), VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:16.355588 5763 raft_consensus.cc:1226] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.359233 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.358081 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:16.354663 5697 debug-util.cc:398] Leaking SignalData structure 0x7b080037f4a0 after lost signal to thread 5702
W20260807 13:33:16.381762 5697 debug-util.cc:398] Leaking SignalData structure 0x7b080036d6e0 after lost signal to thread 5805
I20260807 13:33:16.382349 5769 raft_consensus.cc:1226] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.383279 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.383966 5769 raft_consensus.cc:2379] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:33:16.384342 5697 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3ac0 after lost signal to thread 6738
I20260807 13:33:16.384747 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.385284 5767 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.385360 5761 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:16.386278 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.387310 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.387872 5767 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:16.388842 5767 raft_consensus.cc:1226] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.389755 5767 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.390429 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.391225 5762 raft_consensus.cc:2379] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.381780 5766 raft_consensus.cc:1226] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.357690 7572 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.379506 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.354681 7531 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:16.384708 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.401067 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.403803 7531 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:16.404299 7531 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:16.399035 5555 raft_consensus.cc:2362] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 3. Re-sending same reply.
I20260807 13:33:16.399808 5394 catalog_manager.cc:5495] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:16.406059 5769 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:16.408794 5771 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.411314 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.415300 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.417477 5763 raft_consensus.cc:1226] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.416136 5765 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:16.418330 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.408896 5394 catalog_manager.cc:5495] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:16.427277 5767 raft_consensus.cc:2379] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.427086 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.430814 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.432353 5394 catalog_manager.cc:5495] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 2 to 3, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 3 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:16.433420 5543 raft_consensus.cc:2379] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:16.434000 5394 catalog_manager.cc:5495] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:16.435077 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.437196 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.436728 5394 catalog_manager.cc:5495] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 1 to 3, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:16.441920 5771 raft_consensus.cc:1226] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:16.443944 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.453166 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.457481 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.455260 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.459261 5663 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.462172 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.445827 7578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:32948 (request call id 241) took 5428 ms. Trace:
I20260807 13:33:16.464484 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.466048 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.452227 5394 catalog_manager.cc:5495] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193), VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194), VOTER 737c581af06a42df94970a1542600159 (127.3.187.195), VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 3 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: NON_VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:16.467207 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.471390 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.454254 7572 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:16.473459 5394 catalog_manager.cc:5495] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 2 to 4, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 4 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:16.474961 5663 raft_consensus.cc:2379] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.482262 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.477903 5394 catalog_manager.cc:5495] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:16.483536 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.483754 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.483448 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.484835 5661 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:16.487519 5665 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:16.493067 5767 raft_consensus.cc:2379] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:33:16.495172 7615 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.052s user 0.000s sys 0.001s
I20260807 13:33:16.467236 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.496529 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:16.499641 5499 leader_election.cc:334] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Timed out: RequestConsensusVote RPC to 127.3.187.194:42569 timed out after 1.529s (SENT)
I20260807 13:33:16.497273 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.498646 5667 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:16.502180 5660 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.502705 5665 raft_consensus.cc:1226] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.506840 5662 raft_consensus.cc:1261] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:33:16.529584 5667 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:16.531502 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:16.539535 5499 leader_election.cc:334] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): Timed out: RequestConsensusVote RPC to 127.3.187.194:42569 timed out after 1.538s (SENT)
I20260807 13:33:16.518489 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.544845 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.547530 5767 raft_consensus.cc:2379] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.553969 5658 raft_consensus.cc:2379] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:16.554298 7611 log.cc:924] Time spent T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.093s user 0.001s sys 0.000s
I20260807 13:33:16.550307 5656 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:16.545982 5761 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:16.561039 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.561720 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.562755 5769 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.568181 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.572270 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.573587 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.579049 5548 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:16.574780 5542 raft_consensus.cc:1261] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:16.579697 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:16.574949 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.579699 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.580502 5770 raft_consensus.cc:2379] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.580705 5544 raft_consensus.cc:2379] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:16.582286 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.583274 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.584239 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.584695 5542 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:16.575279 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.568291 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.576730 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.587340 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.577117 5762 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:16.466621 7578 rpcz_store.cc:276] 0807 13:33:11.015139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:11.018002 (+ 2863us) service_pool.cc:227] Handling call
0807 13:33:11.752669 (+734667us) log.cc:842] Serialized 501 byte log entry
0807 13:33:13.211377 (+1458708us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54003df520. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff682306028 00007ff682305c6a 00007ff682371cd5 00007ff68237d084 00007ff68237c743 00007ff682374c1a 00007ff6872b86d9 00007ff6809a2184 00007ff6809a2112 00007ff6809a2041
0807 13:33:16.436937 (+3225560us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":233000704,"thread_start_us":741367,"threads_started":1,"wal-append.queue_time_us":734608,"wal-append.run_cpu_time_us":2015,"wal-append.run_wall_time_us":1156820}
I20260807 13:33:16.577539 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.596526 5765 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:16.597204 5373 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 93d548887d4245c7b22072e49517a84f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 13:33:16.597318 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.598263 5662 raft_consensus.cc:2379] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.558094 7435 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260807 13:33:16.599555 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.573688 5661 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:16.606324 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.608146 5661 raft_consensus.cc:2354] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:16.606383 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.610467 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:16.612200 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 55693.1us
I20260807 13:33:16.618793 5553 raft_consensus.cc:1226] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.620009 5765 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 13:33:16.618122 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.638561 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.639580 5667 raft_consensus.cc:2379] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.646476 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.648372 5548 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:16.660557 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.662276 5666 raft_consensus.cc:2379] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.662797 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.604099 7531 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:16.676898 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.676985 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.670377 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.682021 5721 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:16.680867 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:16.689023 7531 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:16.690867 7632 consensus_queue.cc:1046] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:16.670256 7570 consensus_queue.cc:1046] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260807 13:33:16.681229 6688 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:16.656775 7252 consensus_queue.cc:1046] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260807 13:33:16.699726 7252 raft_consensus.cc:3032] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:16.700064 7252 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:16.700848 7252 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:16.647670 7597 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260807 13:33:16.703817 5542 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:16.677567 5658 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:16.697916 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.709100 7632 raft_consensus.cc:3032] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:16.709470 7632 raft_consensus.cc:729] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:16.710319 7632 consensus_queue.cc:260] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.711548 7632 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:16.714389 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.714951 6637 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:16.715197 5656 raft_consensus.cc:2379] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.723930 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.724704 5662 raft_consensus.cc:2379] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.716941 5722 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:16.755270 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:16.755193 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.773396 5662 raft_consensus.cc:1226] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:16.774595 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.775355 5661 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:16.705967 7572 consensus_queue.cc:1046] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260807 13:33:16.777169 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.724500 7252 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:16.724241 7597 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:16.772737 5659 raft_consensus.cc:1261] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:16.784314 5618 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:16.788599 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 71700.9us
I20260807 13:33:16.787873 5660 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260807 13:33:16.789546 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 107593us
I20260807 13:33:16.773877 5658 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.798559 5722 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:16.790591 7578 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:16.801806 5721 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:16.706233 7634 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.093s
I20260807 13:33:16.753829 7289 consensus_queue.cc:1046] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260807 13:33:16.800827 5656 raft_consensus.cc:1226] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.813601 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.792322 7418 consensus_queue.cc:1046] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260807 13:33:16.809365 7578 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:16.810947 7499 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:16.799232 7531 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260807 13:33:16.811298 7628 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:16.831768 5660 raft_consensus.cc:1226] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.822736 7373 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:16.852229 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.839090 7289 raft_consensus.cc:3032] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:16.851477 7499 raft_consensus.cc:686] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:16.874408 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.877166 5660 raft_consensus.cc:2379] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.894860 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:16.877841 7548 consensus_queue.cc:1035] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:16.895597 5770 raft_consensus.cc:2379] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.895828 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.896616 5660 raft_consensus.cc:2379] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.897413 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.854229 7373 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:16.898419 7373 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:16.902426 5660 raft_consensus.cc:2396] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:16.903252 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.904001 5660 raft_consensus.cc:2379] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.904757 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.876556 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.905881 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:16.906965 7625 log.cc:924] Time spent T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.215s user 0.004s sys 0.000s
I20260807 13:33:16.851931 7578 consensus_queue.cc:1046] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260807 13:33:16.880452 5656 raft_consensus.cc:1226] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:16.888677 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.889650 7368 raft_consensus.cc:3032] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:16.891638 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:16.892330 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.893096 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.871574 7289 raft_consensus.cc:729] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:16.918543 7289 consensus_queue.cc:260] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.920140 7289 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:16.918565 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.922456 5662 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:16.923409 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.906769 5659 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:16.924362 7578 raft_consensus.cc:3032] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:16.924741 7578 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:16.927266 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.879241 7499 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:16.923470 7368 raft_consensus.cc:729] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:16.905942 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:16.908546 5722 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:16.933841 5666 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
W20260807 13:33:16.933898 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 226772us
I20260807 13:33:16.932132 5660 raft_consensus.cc:2379] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:16.941515 5767 raft_consensus.cc:1261] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 13:33:16.941598 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 109506us
I20260807 13:33:16.953697 5771 raft_consensus.cc:1261] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:16.925611 7578 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.957477 7631 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260807 13:33:16.966035 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 57590.8us
I20260807 13:33:16.959349 5658 raft_consensus.cc:2379] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:16.954015 7632 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:16.969264 5620 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:16.975668 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 203350us
I20260807 13:33:16.982452 7278 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:16.955304 7373 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:16.985774 7426 consensus_queue.cc:1035] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:16.986359 5620 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:16.988060 5721 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:16.989802 7524 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:16.990152 5620 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:16.992194 5501 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:17.021800 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 57687.3us
I20260807 13:33:17.030655 5620 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:17.035223 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 55881.1us
I20260807 13:33:16.981751 7572 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260807 13:33:17.036466 5620 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:17.035612 7524 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:17.034368 7278 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:17.034495 7578 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:17.037794 7426 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:17.056538 5553 raft_consensus.cc:3032] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
W20260807 13:33:17.061487 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 73537.6us
I20260807 13:33:17.063401 5721 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.064496 5501 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:17.049268 6688 raft_consensus.cc:1226] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:17.062502 5553 raft_consensus.cc:729] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.066118 7418 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.066948 7665 consensus_queue.cc:1046] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:17.064939 7645 raft_consensus.cc:3032] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:17.057319 7651 raft_consensus.cc:3032] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.053980 7660 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:17.080791 5721 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.081532 5553 consensus_queue.cc:260] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.054844 7368 consensus_queue.cc:260] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:17.067683 7524 raft_consensus.cc:686] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:17.072499 7645 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.086617 7634 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.083052 5499 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.126435 5721 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.073566 7651 raft_consensus.cc:729] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:33:17.130752 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 47780.4us
I20260807 13:33:17.084589 7373 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:17.132305 7373 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:33:17.132356 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 45307.3us
I20260807 13:33:17.085000 7548 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.136132 7666 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:17.054405 7653 consensus_queue.cc:1046] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260807 13:33:17.081996 7660 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:17.142794 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 78343.9us
I20260807 13:33:17.147797 7669 consensus_queue.cc:1046] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 13:33:17.148967 7669 raft_consensus.cc:3032] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:17.148578 7651 consensus_queue.cc:260] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.149303 7669 raft_consensus.cc:729] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.149870 7651 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.150311 7634 consensus_queue.cc:1046] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:17.151338 7634 raft_consensus.cc:3032] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.151630 7634 raft_consensus.cc:729] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.152407 7634 consensus_queue.cc:260] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.153692 7634 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.154444 7669 consensus_queue.cc:260] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.163488 5721 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.138463 7632 raft_consensus.cc:686] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.165872 5721 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.143950 7660 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.172762 7368 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.177245 7373 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.179867 5501 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:17.167099 7572 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:17.185770 7632 consensus_queue.cc:237] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.186340 7677 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.187207 5721 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.188441 5721 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.136770 7666 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.181910 7675 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.191017 5499 leader_election.cc:398] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:17.191395 5499 leader_election.cc:401] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 13:33:17.191926 7666 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:17.194235 7524 consensus_queue.cc:237] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.182314 7669 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:17.168431 7548 consensus_queue.cc:1046] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260807 13:33:17.211485 7678 raft_consensus.cc:3032] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.188771 7572 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:17.213327 7678 raft_consensus.cc:729] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.207342 7677 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:17.162715 7645 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:17.219327 5721 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:17.221375 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 160443us
W20260807 13:33:17.221758 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 57322.4us
I20260807 13:33:17.222854 5620 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:17.223874 7524 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.224936 7678 consensus_queue.cc:260] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.226320 5553 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.226459 5620 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:17.225747 5499 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.227406 7524 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.215745 7675 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:17.228698 5620 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:17.228770 7675 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:17.230827 5721 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.231863 7548 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.231936 5721 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:17.232570 7548 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.232879 7637 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:17.233156 5721 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.234061 7659 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.234611 7660 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.235347 7645 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:17.235689 7675 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:17.236672 7524 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.236744 7660 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:17.238190 5620 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:17.239427 5620 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:17.240119 7524 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:17.240173 7373 raft_consensus.cc:3032] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.212193 7667 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:17.218892 7572 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:17.242412 5721 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.255683 5721 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.247087 5620 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:17.228318 5499 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:17.212129 7426 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:17.246312 7373 raft_consensus.cc:729] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.255919 7677 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:17.247069 5553 raft_consensus.cc:1261] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:17.258688 5620 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:17.263370 5721 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.263731 5620 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:17.226400 7678 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.265545 7499 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:17.265611 7666 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.265929 7426 raft_consensus.cc:686] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.265560 7677 raft_consensus.cc:686] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.266937 7426 consensus_queue.cc:237] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:17.267632 7672 log.cc:924] Time spent T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Append to log took a long time: real 0.136s user 0.003s sys 0.000s
I20260807 13:33:17.267519 7677 consensus_queue.cc:237] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.269173 5620 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:17.270761 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 48298.8us
I20260807 13:33:17.249748 7524 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 13:33:17.272236 7650 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260807 13:33:17.261560 7278 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.269220 7632 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 13:33:17.278390 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 50163us
I20260807 13:33:17.269173 7667 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:17.270473 7634 raft_consensus.cc:2741] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:33:17.281570 7373 consensus_queue.cc:260] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.282903 7660 consensus_queue.cc:1046] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:17.276981 7499 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.283699 7578 consensus_queue.cc:1046] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:17.277700 5620 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:17.294545 5501 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.297019 7667 raft_consensus.cc:3032] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:17.297132 7578 raft_consensus.cc:3032] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.297420 7667 raft_consensus.cc:729] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.300034 5499 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.297600 7578 raft_consensus.cc:729] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.304046 7654 raft_consensus.cc:3032] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.304533 7654 raft_consensus.cc:729] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.304026 7578 consensus_queue.cc:260] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.300779 7499 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:17.301612 5501 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:17.301267 7667 consensus_queue.cc:260] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.302251 7650 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:17.302930 7373 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.315769 7667 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:17.288975 7278 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:17.298580 5721 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.308353 7578 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.308213 7654 consensus_queue.cc:260] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.326762 7278 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:17.338970 7690 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:17.339352 7278 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:17.340252 7278 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:17.342351 5721 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.343907 5721 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:17.312860 7368 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:17.343852 7659 consensus_queue.cc:1035] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:17.344671 7368 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.345548 7659 consensus_queue.cc:1046] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:17.346095 7634 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.346776 7634 raft_consensus.cc:3032] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:17.346635 7368 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:17.347244 7634 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.344694 7637 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.346577 7659 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:17.348140 7634 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.348500 7659 raft_consensus.cc:686] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.349344 7634 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:17.349695 7659 consensus_queue.cc:237] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.359156 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:17.359400 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:17.359797 5663 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:17.360167 6688 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:17.322233 7660 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:33:17.366285 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 64728.5us
I20260807 13:33:17.367386 7654 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.367925 5621 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:17.339398 7690 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:17.370702 5501 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.310611 7572 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:17.379722 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 74172us
I20260807 13:33:17.379186 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:17.371675 7524 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:17.372588 7690 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:17.389765 7650 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260807 13:33:17.412142 7675 consensus_queue.cc:1046] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:17.413206 7675 raft_consensus.cc:3032] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.413516 7675 raft_consensus.cc:729] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.404045 7665 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260807 13:33:17.414353 7675 consensus_queue.cc:260] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.415529 7675 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.387990 7660 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.394204 7592 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:17.392856 7524 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:17.429817 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:17.429728 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:17.431190 5499 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.432216 5770 raft_consensus.cc:2379] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:17.404330 7368 consensus_queue.cc:1035] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 13:33:17.441570 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:17.448033 5762 raft_consensus.cc:2379] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:17.426630 7524 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:17.426790 7499 raft_consensus.cc:686] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:17.452941 5499 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:17.454999 5771 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:17.459017 5501 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.426357 7592 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:17.432221 7650 consensus_queue.cc:1046] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 13:33:17.472846 5499 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.434772 7660 consensus_queue.cc:1046] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260807 13:33:17.478394 7688 log.cc:924] Time spent T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.160s user 0.001s sys 0.000s
I20260807 13:33:17.478849 7700 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:17.478605 7499 consensus_queue.cc:237] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:17.458665 7665 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:17.505990 5661 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37b9562e68354bc69b54b07a09406578"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "737c581af06a42df94970a1542600159"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:33:17.506811 5661 raft_consensus.cc:595] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Received request to transfer leadership to TS 737c581af06a42df94970a1542600159
I20260807 13:33:17.494408 7570 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.505576 7650 raft_consensus.cc:3032] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.522871 7650 raft_consensus.cc:729] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.523661 7650 consensus_queue.cc:260] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.524794 7650 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:17.525934 7694 log.cc:924] Time spent T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.109s user 0.001s sys 0.000s
W20260807 13:33:17.526613 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 53862.9us
I20260807 13:33:17.481920 7572 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:17.513216 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 54258.8us
I20260807 13:33:17.472383 7667 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:17.522508 7660 raft_consensus.cc:3032] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.534451 5499 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:33:17.535605 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 93356.7us
I20260807 13:33:17.536311 7690 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.538092 7592 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:17.528524 7700 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.544080 7660 raft_consensus.cc:729] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.566303 7572 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:17.567898 7700 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:17.568388 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:17.570137 5501 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.528748 7651 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:17.576108 5499 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:33:17.545593 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 85679.9us
I20260807 13:33:17.583151 6688 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260807 13:33:17.599205 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 55229.2us
I20260807 13:33:17.574766 7572 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:17.583099 5663 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:17.600250 7667 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.611771 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:17.615612 5501 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:17.607075 7572 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:17.622016 5721 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:17.626237 5499 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.614315 7650 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:17.639643 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:17.640426 5762 raft_consensus.cc:2379] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 2: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:17.631914 7654 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 13:33:17.643015 7709 log.cc:924] Time spent T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260807 13:33:17.640892 5663 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:33:17.653178 5663 raft_consensus.cc:595] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Received request to transfer leadership to TS d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:17.636705 7570 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:17.661396 7570 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:17.664942 5762 raft_consensus.cc:1261] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:17.621940 7660 consensus_queue.cc:260] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.666168 7651 consensus_queue.cc:1046] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:17.634788 7653 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:17.666986 7653 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:17.667451 7653 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:17.668547 5499 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:17.664212 7570 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:17.615783 7700 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260807 13:33:17.632373 7426 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:17.721961 5501 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.632222 7714 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:17.670320 7678 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.620050 7524 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:17.677842 7654 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:17.726903 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:17.778455 5390 catalog_manager.cc:5495] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:33:17.784241 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 114373us
I20260807 13:33:17.723800 7675 consensus_queue.cc:1046] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260807 13:33:17.743703 7570 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:17.746901 7426 raft_consensus.cc:686] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:17.792773 5659 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:17.796414 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:17.683022 7719 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260807 13:33:17.775076 7678 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.760571 5663 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:33:17.777012 7690 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:17.794325 5390 catalog_manager.cc:5495] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 reported cstate change: config changed from index 4 to 3, leader changed from <none> to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196), VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) added, now has a pending config: VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193), VOTER 737c581af06a42df94970a1542600159 (127.3.187.195), VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 4 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } attrs { replace: true } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:17.776291 7722 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:17.801596 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:17.806126 5667 raft_consensus.cc:1261] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:17.806139 5390 catalog_manager.cc:5495] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:17.790457 7682 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:17.820456 7682 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.822428 7682 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:17.823490 7426 consensus_queue.cc:237] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.826543 5646 tablet_service.cc:1514] Processing DeleteTablet for tablet c61e1dd5b00c43d2a1747f4832ac333c with delete_type TABLET_DATA_TOMBSTONED (TS 0b9aca0aafaa43e7998ee8f3e59627e0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52568
I20260807 13:33:17.826877 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:17.828434 5501 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.730513 7680 consensus_queue.cc:1046] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260807 13:33:17.832297 5501 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:17.793490 7650 raft_consensus.cc:686] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.844599 7578 consensus_queue.cc:1035] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:17.842530 7368 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:17.756302 7714 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.856184 5394 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51200 (request call id 190) took 1710 ms. Trace:
I20260807 13:33:17.831069 5663 raft_consensus.cc:595] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Received request to transfer leadership to TS d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:17.856637 5394 rpcz_store.cc:276] 0807 13:33:16.131643 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:16.134248 (+ 2605us) service_pool.cc:227] Handling call
0807 13:33:17.837863 (+1703615us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:16.974323 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:16.982316 (+ 7993us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:16.982368 (+ 52us) write_op.cc:435] Acquired schema lock
0807 13:33:16.982388 (+ 20us) tablet.cc:660] Decoding operations
0807 13:33:17.058640 (+ 76252us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:17.058736 (+ 96us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:17.058780 (+ 44us) tablet.cc:683] Acquiring locks for 9 operations
0807 13:33:17.059586 (+ 806us) tablet.cc:699] Row locks acquired
0807 13:33:17.059622 (+ 36us) write_op.cc:260] PREPARE: finished
0807 13:33:17.059778 (+ 156us) write_op.cc:270] Start()
0807 13:33:17.059908 (+ 130us) write_op.cc:276] Timestamp: P: 1786109597059722 usec, L: 0
0807 13:33:17.059948 (+ 40us) op_driver.cc:331] REPLICATION: starting
0807 13:33:17.060606 (+ 658us) log.cc:842] Serialized 3915 byte log entry
0807 13:33:17.246447 (+185841us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:17.387518 (+141071us) op_driver.cc:444] REPLICATION: finished
0807 13:33:17.538294 (+150776us) write_op.cc:301] APPLY: starting
0807 13:33:17.538381 (+ 87us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:17.538602 (+ 221us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:17.538639 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:17.565201 (+ 26562us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:17.565548 (+ 347us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0807 13:33:17.565613 (+ 65us) write_op.cc:312] APPLY: finished
0807 13:33:17.565964 (+ 351us) log.cc:842] Serialized 70 byte log entry
0807 13:33:17.578413 (+ 12449us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:17.586471 (+ 8058us) write_op.cc:454] Released schema lock
0807 13:33:17.600832 (+ 14361us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:17.602720 (+ 1888us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:17.602767 (+ 47us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":142176,"apply.run_cpu_time_us":4187,"apply.run_wall_time_us":71020,"num_ops":9,"prepare.queue_time_us":268217,"prepare.run_cpu_time_us":17704,"prepare.run_wall_time_us":113427,"raft.queue_time_us":110329,"raft.run_cpu_time_us":8088,"raft.run_wall_time_us":86918,"replication_time_us":327467,"spinlock_wait_cycles":7764736,"thread_start_us":319703,"threads_started":4,"wal-append.queue_time_us":70843}]]}
I20260807 13:33:17.813541 5390 catalog_manager.cc:5495] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:17.865540 5390 catalog_manager.cc:5495] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:17.835614 7531 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:17.875494 7690 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:17.876132 7690 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:17.864912 7368 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.876545 7690 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:17.877890 7368 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:17.878484 7690 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:17.879496 7734 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:17.879881 7734 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:17.880236 7734 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:17.873898 5501 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.882278 7675 consensus_queue.cc:1225] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 0b9aca0aafaa43e7998ee8f3e59627e0 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:33:17.883011 7675 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:17.883679 7675 consensus_queue.cc:1046] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:17.884057 5501 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:17.884821 7675 consensus_queue.cc:1046] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:17.872972 7650 consensus_queue.cc:237] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.830435 7722 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.875211 7531 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:17.885802 7675 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:17.871085 5390 catalog_manager.cc:5495] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:17.866441 5663 raft_consensus.cc:603] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:17.818224 7570 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.913213 5667 raft_consensus.cc:1261] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:17.913841 7667 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:17.914191 7654 raft_consensus.cc:686] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.914984 7665 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:17.914600 7675 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.919806 7714 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:17.921057 5501 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:17.921561 7660 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:17.902710 5390 catalog_manager.cc:5495] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 2 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:17.848682 7678 consensus_queue.cc:1046] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260807 13:33:17.897291 7592 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:17.943101 5665 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:17.939742 5660 pending_rounds.cc:76] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting all ops after (but not including) 1
I20260807 13:33:17.923209 7722 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:17.952154 5660 pending_rounds.cc:97] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:33:17.953343 5660 raft_consensus.cc:2866] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:17.928064 7680 raft_consensus.cc:3032] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:17.951576 7669 consensus_queue.cc:1035] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260807 13:33:17.958532 5501 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:17.961872 7742 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:17.962321 7742 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:17.962659 7742 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:17.962852 5656 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:17.966826 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:17.945250 7667 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:17.941237 7682 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:17.966460 7654 consensus_queue.cc:237] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.951849 7578 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:17.967931 7680 raft_consensus.cc:729] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:17.957782 7524 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:17.970351 7667 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:17.954872 7592 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:18.023739 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 65281.2us
I20260807 13:33:18.025157 5501 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:18.026046 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 173547us
I20260807 13:33:17.978796 7632 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260807 13:33:17.952023 7734 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:17.979422 7682 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:18.101058 5618 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.696s (SENT) [suppressed 74 similar messages]
I20260807 13:33:18.020503 7667 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:18.138588 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.031467 7426 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.140321 5765 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:18.151469 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.152382 5762 raft_consensus.cc:2379] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:17.997423 7578 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.164368 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.165447 5765 raft_consensus.cc:2396] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:18.169781 7426 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.128526 7752 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:18.171669 5620 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:18.170545 7745 tablet_replica.cc:330] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: stopping tablet replica
I20260807 13:33:18.124545 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:18.197515 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.198493 5763 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
W20260807 13:33:18.201385 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 176310us
I20260807 13:33:18.202163 5501 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:18.203163 5659 raft_consensus.cc:1226] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:18.175330 7531 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.205622 6638 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:18.208518 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:18.209636 7740 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.210271 7740 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.211877 7701 raft_consensus.cc:979] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0: : Instructing follower 737c581af06a42df94970a1542600159 to start an election
W20260807 13:33:18.213116 7744 log.cc:924] Time spent T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260807 13:33:18.213414 7690 raft_consensus.cc:3032] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
W20260807 13:33:18.216265 7653 consensus_meta.cc:287] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.548s user 0.008s sys 0.003s
I20260807 13:33:18.216635 7653 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.194787 7570 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.213840 7690 raft_consensus.cc:729] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:18.219985 7690 consensus_queue.cc:260] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:18.221869 7572 consensus_meta.cc:287] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.588s user 0.006s sys 0.001s
I20260807 13:33:18.178007 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:18.224435 7748 log.cc:924] Time spent T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.092s user 0.000s sys 0.000s
I20260807 13:33:18.222368 7754 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:18.183640 7678 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:18.194301 7368 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:18.238353 7368 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:18.238723 7368 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:18.198802 7675 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:18.234001 7738 log.cc:924] Time spent T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.273s user 0.001s sys 0.000s
I20260807 13:33:18.237892 7742 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.242736 7592 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.243311 7714 raft_consensus.cc:1067] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Signalling peer 737c581af06a42df94970a1542600159 to start an election
I20260807 13:33:18.244932 7745 raft_consensus.cc:2229] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:33:18.245841 7745 raft_consensus.cc:2258] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:33:18.246400 7373 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.246896 7373 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.247458 7651 raft_consensus.cc:3032] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:18.247985 7651 raft_consensus.cc:729] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:18.248797 7745 ts_tablet_manager.cc:1905] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:33:18.248980 7651 consensus_queue.cc:260] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.246896 7736 raft_consensus.cc:3032] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:18.250794 7736 raft_consensus.cc:729] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:18.251845 7736 consensus_queue.cc:260] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.252481 7368 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.253382 7736 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:18.254971 7578 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:18.255932 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.256510 5771 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:18.230171 5501 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:18.255422 7368 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:18.271008 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 169978us
W20260807 13:33:18.311503 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 56173.6us
I20260807 13:33:18.266392 7660 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 13:33:18.319159 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 89097.2us
I20260807 13:33:18.324466 5501 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:18.249018 7373 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:18.256397 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:18.338191 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:18.344266 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:18.345491 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:18.318534 7677 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.331584 5658 raft_consensus.cc:2379] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:18.332217 5663 raft_consensus.cc:2354] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
I20260807 13:33:18.230427 7572 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.182606 7680 consensus_queue.cc:260] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.333612 7665 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:18.183292 7752 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.338617 7742 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.355691 5659 raft_consensus.cc:1261] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:18.362730 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:18.348538 7660 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:18.345196 7690 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:18.361732 5771 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37b9562e68354bc69b54b07a09406578"
dest_uuid: "737c581af06a42df94970a1542600159"
from {username='slave'} at 127.0.0.1:32950
I20260807 13:33:18.364990 5620 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:18.367741 5771 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:33:18.368242 5771 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:18.368721 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:18.365634 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.372611 5762 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:18.380275 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:18.380112 5771 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.359894 7651 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:18.363737 5656 raft_consensus.cc:2379] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:18.385495 7682 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.363982 7653 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.385916 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:18.390182 7766 consensus_queue.cc:1046] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.164s
I20260807 13:33:18.392865 5762 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:18.380604 7524 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:18.365415 7578 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.398427 7578 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.400413 7578 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:18.396164 7418 raft_consensus.cc:979] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: : Instructing follower d6b8ccce5b91423b8673ddfbbf2c1b1c to start an election
I20260807 13:33:18.401137 7660 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:18.401664 7418 raft_consensus.cc:1067] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Signalling peer d6b8ccce5b91423b8673ddfbbf2c1b1c to start an election
I20260807 13:33:18.397069 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.402011 7667 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.402485 5763 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:18.404212 7667 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.404742 6696 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3"
dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
from {username='slave'} at 127.0.0.1:57212
I20260807 13:33:18.405352 6696 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:33:18.405388 5771 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:18.405761 6696 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:18.380872 5665 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:18.414770 5765 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 13:33:18.418151 6638 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:18.354509 7774 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:18.362390 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:18.422284 5620 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:18.354260 7677 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.404691 7524 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:33:18.424252 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 99869.6us
I20260807 13:33:18.435209 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.360085 7675 consensus_queue.cc:1046] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260807 13:33:18.435833 5762 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:18.376159 7734 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.377063 7740 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:18.421871 7779 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:18.439919 5620 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:18.437940 7524 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:18.353331 7770 consensus_queue.cc:1046] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260807 13:33:18.425432 7774 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:18.455675 5501 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:18.465054 6696 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.470721 5542 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:18.435315 7701 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:18.474036 6696 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.468340 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:18.468529 7770 raft_consensus.cc:3032] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:18.467446 7645 consensus_queue.cc:1035] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:18.472827 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:18.447647 7779 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:18.453943 7714 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:18.445996 7426 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:18.446364 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:18.476989 5721 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:18.475073 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.480556 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.480950 5770 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:18.477903 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:18.479939 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:18.481874 5556 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:18.483157 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:18.469931 7677 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:18.483697 5660 raft_consensus.cc:3032] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:18.501618 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.500916 5660 raft_consensus.cc:729] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:18.460556 7774 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:18.445850 7682 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260807 13:33:18.503059 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.508559 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.472921 7669 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.481154 5542 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
W20260807 13:33:18.476828 7672 log.cc:924] Time spent T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Append to log took a long time: real 0.125s user 0.000s sys 0.001s
I20260807 13:33:18.505671 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.505947 5552 raft_consensus.cc:1226] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:18.506265 7784 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.506578 7767 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 13:33:18.509773 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:18.562816 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.563261 5666 raft_consensus.cc:3032] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:18.563601 5666 raft_consensus.cc:729] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:18.563885 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.564508 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.564888 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.509840 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:18.502329 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 44345.9us
I20260807 13:33:18.501767 7426 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:18.480324 7714 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:18.564311 5666 consensus_queue.cc:260] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.570415 7714 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:18.570930 5666 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:18.424564 7742 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:18.577175 5556 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:18.577888 5548 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260807 13:33:18.477187 7734 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:18.579762 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.511274 5769 raft_consensus.cc:1226] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:18.476003 7770 raft_consensus.cc:729] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:18.586807 5770 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:18.479475 7779 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:18.561408 5765 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:18.557379 5660 consensus_queue.cc:260] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.588280 6638 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:18.580849 5661 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:18.573735 5499 leader_election.cc:398] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
I20260807 13:33:18.504316 7368 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.591368 5499 leader_election.cc:401] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:18.480973 6685 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:18.585465 5552 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:18.515846 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.515441 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.586592 5725 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:18.560278 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:18.504369 7701 raft_consensus.cc:686] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:18.580427 5767 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:18.574277 7426 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:18.598502 5769 raft_consensus.cc:1226] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:18.581813 7572 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.562412 7669 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.592133 7734 raft_consensus.cc:686] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:18.599164 7592 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader election won for term 2
W20260807 13:33:18.617717 7769 log.cc:924] Time spent T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.247s user 0.001s sys 0.000s
I20260807 13:33:18.581467 7666 consensus_queue.cc:1035] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260807 13:33:18.636664 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.637957 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:18.638796 5552 raft_consensus.cc:2379] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 2: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:18.638875 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.639791 5555 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:18.639844 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.641067 5766 raft_consensus.cc:2354] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
I20260807 13:33:18.640950 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.632004 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.647308 7734 consensus_queue.cc:237] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.622467 7740 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 3
I20260807 13:33:18.661798 5763 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
W20260807 13:33:18.628595 7768 log.cc:924] Time spent T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.127s user 0.004s sys 0.000s
I20260807 13:33:18.622069 7754 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:18.625277 7426 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:18.664773 5555 raft_consensus.cc:2396] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:18.665445 5666 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 2.
I20260807 13:33:18.674911 7745 ts_tablet_manager.cc:1918] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 13:33:18.675123 5554 raft_consensus.cc:1261] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260807 13:33:18.679455 7777 log.cc:924] Time spent T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.257s user 0.000s sys 0.001s
I20260807 13:33:18.679643 7669 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:18.632536 7572 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.595623 7368 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.632292 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:18.695567 5542 raft_consensus.cc:1261] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:18.567073 7784 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.664834 7665 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.661511 7592 raft_consensus.cc:686] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:18.724352 5554 raft_consensus.cc:1261] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:18.725369 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.663509 7524 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.713109 7745 log.cc:1196] T c61e1dd5b00c43d2a1747f4832ac333c P 0b9aca0aafaa43e7998ee8f3e59627e0: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-1-root/wals/c61e1dd5b00c43d2a1747f4832ac333c
W20260807 13:33:18.713676 7783 log.cc:924] Time spent T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.206s user 0.001s sys 0.000s
I20260807 13:33:18.714954 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:18.715979 7762 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.400s user 0.001s sys 0.002s
I20260807 13:33:18.754161 5663 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:18.710860 7572 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.766783 7714 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.767741 7572 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.768702 7714 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.634615 7770 consensus_queue.cc:260] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.706005 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:18.729012 7368 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:18.771277 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 184747us
I20260807 13:33:18.731361 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.732076 6637 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
W20260807 13:33:18.743777 7678 consensus_meta.cc:287] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.505s user 0.005s sys 0.005s
I20260807 13:33:18.733292 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.790791 5555 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:18.791643 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.735112 5501 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:18.735123 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:18.730250 7289 consensus_queue.cc:1046] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:18.772106 5666 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:18.776067 5665 raft_consensus.cc:2379] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:18.732187 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:18.800379 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.801043 5769 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:18.813609 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:18.726866 7665 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.740228 7752 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.793828 7678 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:18.794335 7714 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.828115 7779 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:18.806377 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 47451.8us
I20260807 13:33:18.711279 7701 consensus_queue.cc:237] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.805668 7531 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:18.811069 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:18.831075 5552 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:18.802037 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:18.838343 7531 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:18.840606 6687 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:18.843199 7531 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:18.843905 7774 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.840739 7592 consensus_queue.cc:237] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.842352 7669 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.835963 7714 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.851998 7669 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:18.852958 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 279311us
W20260807 13:33:18.815781 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 83808.1us
I20260807 13:33:18.855086 5621 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:18.830806 6680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57212 (request call id 115) took 1023 ms. Trace:
I20260807 13:33:18.866675 7774 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.867921 7531 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.872115 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:18.873224 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.873234 5666 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
W20260807 13:33:18.874752 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 150822us
I20260807 13:33:18.880450 7531 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:18.883615 5722 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:18.895534 6688 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:18.895748 7680 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:18.899246 5762 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:18.873615 7666 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:18.903139 6638 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:18.873078 6681 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:18.900432 5621 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:18.923864 7779 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.926733 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.927464 5763 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:18.929003 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:18.929919 5666 raft_consensus.cc:2379] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:18.931887 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:18.907783 7666 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:18.911252 7645 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:18.917131 7368 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:18.916637 7278 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:18.948429 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.919826 7745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52568 (request call id 350) took 1086 ms. Trace:
I20260807 13:33:18.952414 7278 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.954346 7745 rpcz_store.cc:276] 0807 13:33:17.823730 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:17.826260 (+ 2530us) service_pool.cc:227] Handling call
0807 13:33:18.031782 (+205522us) ts_tablet_manager.cc:1145] Deleting tablet c61e1dd5b00c43d2a1747f4832ac333c
0807 13:33:18.153002 (+121220us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0807 13:33:18.469220 (+316218us) tablet_metadata.cc:641] Metadata flushed
0807 13:33:18.674648 (+205428us) tablet_metadata.cc:641] Metadata flushed
0807 13:33:18.910391 (+235743us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":184144,"thread_start_us":108446,"threads_started":1}
I20260807 13:33:18.958166 7278 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.900799 6637 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:18.928263 7774 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:33:18.934335 7786 log.cc:924] Time spent T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260807 13:33:18.911440 7784 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:18.926939 7524 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:18.934417 5656 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:18.968427 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:19.005523 7669 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.000592 7774 raft_consensus.cc:686] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:19.008203 7774 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:18.972303 7368 raft_consensus.cc:686] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:18.943387 7666 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.016290 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:18.973083 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:18.942665 7645 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.019119 7645 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:19.020287 7578 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.021054 7578 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.016718 7752 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:19.024948 7752 raft_consensus.cc:686] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
W20260807 13:33:19.025301 7651 consensus_meta.cc:287] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.608s user 0.010s sys 0.001s
W20260807 13:33:19.026126 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 148791us
I20260807 13:33:19.026578 7752 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:19.030941 5543 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 13:33:19.031984 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.032810 5543 raft_consensus.cc:2396] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260807 13:33:19.033516 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.036933 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.044261 5659 raft_consensus.cc:1261] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:33:19.045018 5542 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:19.047547 5542 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:19.054850 7667 raft_consensus.cc:3032] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:19.055435 7667 raft_consensus.cc:729] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:19.056533 7667 consensus_queue.cc:260] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:18.869853 6680 rpcz_store.cc:276] 0807 13:33:17.807954 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:17.812937 (+ 4983us) service_pool.cc:227] Handling call
0807 13:33:17.843999 (+ 31062us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:17.844337 (+ 338us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:17.844363 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:17.844814 (+ 451us) log.cc:842] Serialized 26 byte log entry
0807 13:33:18.151124 (+306310us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:18.168862 (+ 17738us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:18.176373 (+ 7511us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:18.694037 (+517664us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:18.772857 (+ 78820us) raft_consensus.cc:1671] finished
0807 13:33:18.772879 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:18.822022 (+ 49143us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2148,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4838,"spinlock_wait_cycles":54553856,"thread_start_us":290498,"threads_started":1,"wal-append.queue_time_us":355403}
I20260807 13:33:19.065948 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.065949 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:19.066813 5543 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:19.069621 7740 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
I20260807 13:33:19.061429 7667 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:19.070349 7578 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:19.075260 7804 log.cc:924] Time spent T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.210s user 0.001s sys 0.001s
I20260807 13:33:19.089448 5543 raft_consensus.cc:1226] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:19.093650 5543 raft_consensus.cc:1261] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:19.095194 5543 raft_consensus.cc:1226] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:19.096432 5543 raft_consensus.cc:1226] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:19.097532 5543 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:19.036578 7665 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.118669 5769 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:19.108206 7426 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.011466 7368 consensus_queue.cc:237] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:19.098902 5543 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:19.143680 5763 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:19.149806 5543 raft_consensus.cc:1261] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:19.152725 5543 raft_consensus.cc:1226] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:19.161011 5766 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:19.117676 6636 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:19.154163 7634 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:19.180202 7714 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:19.190622 7758 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.192059 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:19.167063 7690 consensus_meta.cc:287] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.793s user 0.007s sys 0.005s
I20260807 13:33:19.207605 5554 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:19.206036 7418 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.215152 7426 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.217306 5544 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:19.219990 5660 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:19.228555 7742 consensus_meta.cc:287] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.547s user 0.010s sys 0.003s
I20260807 13:33:19.228885 7810 raft_consensus.cc:3032] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
W20260807 13:33:19.236807 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 501728us
I20260807 13:33:19.243789 5501 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:19.237773 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 374594us
I20260807 13:33:19.252496 5555 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:19.256492 5499 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:19.251926 5543 raft_consensus.cc:1226] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:19.239936 7572 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:19.243526 7779 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:19.240985 7654 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:19.267678 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 349789us
W20260807 13:33:19.270838 5721 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.516s user 0.012s sys 0.030s
W20260807 13:33:19.239872 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 141348us
I20260807 13:33:19.242334 7810 raft_consensus.cc:729] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:19.273587 5721 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.518s user 0.012s sys 0.030s
I20260807 13:33:19.278447 5501 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:19.279924 5501 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:19.281227 5501 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:19.283396 5501 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:19.266685 7660 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:19.303049 5725 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.000s sys 0.023s
W20260807 13:33:19.304502 5725 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.532s user 0.000s sys 0.023s
W20260807 13:33:19.303850 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 47454.4us
I20260807 13:33:19.305673 7739 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:19.242902 7418 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.312464 5548 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:19.314594 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:19.280210 7714 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.315374 5665 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:19.319344 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:19.305223 7680 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:19.321873 5501 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:19.305184 7570 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:19.307183 7754 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:19.240005 7758 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.331431 5501 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:19.280697 7654 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:19.330660 5761 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s user 0.006s sys 0.020s
W20260807 13:33:19.341746 5761 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.523s user 0.006s sys 0.021s
I20260807 13:33:19.342199 7835 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.343077 7835 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.352308 5501 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:19.329581 7665 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:19.327069 7756 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.307694 7660 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.361136 5501 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:19.361668 5369 catalog_manager.cc:4841] TS 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): tablet c61e1dd5b00c43d2a1747f4832ac333c (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:33:19.362630 5501 leader_election.cc:398] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3.
I20260807 13:33:19.363646 5501 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:19.365856 5501 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:19.367987 5620 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.370031 5620 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.349022 7739 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:19.346815 7675 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.347105 7754 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:19.321930 7714 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.392609 5618 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:19.392692 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.384435 5660 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:19.382923 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.394194 5543 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:19.395224 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:19.334439 7426 consensus_queue.cc:1035] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260807 13:33:19.388773 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:19.390321 7753 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.390753 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:19.385679 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:19.372331 7740 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.397369 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.398551 7657 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.365064 7570 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:19.364615 7678 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.376047 7578 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.402918 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.369112 7680 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:33:19.397425 7820 log.cc:924] Time spent T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260807 13:33:19.419803 7767 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:19.395483 7675 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.421994 7418 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.423094 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.423452 7675 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.423707 5554 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:19.424085 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:19.424582 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:19.425220 5554 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:19.421703 7678 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.427066 5542 raft_consensus.cc:1261] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:33:19.427462 5542 pending_rounds.cc:76] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 1
I20260807 13:33:19.427703 5542 pending_rounds.cc:97] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:33:19.427776 7660 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.428260 7678 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.430080 7654 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.387854 7722 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.431439 7722 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.384150 7645 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:19.425659 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:19.435493 5544 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:19.392791 7278 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:19.373674 7682 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:19.376340 7734 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:19.389038 7499 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.383646 7289 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.417333 5543 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:19.417091 7578 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.417436 7832 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.419411 7700 consensus_queue.cc:1046] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260807 13:33:19.434284 7824 log.cc:924] Time spent T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260807 13:33:19.370396 7756 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.408471 7740 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:19.427953 5542 raft_consensus.cc:2866] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:19.446936 7722 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.420316 6681 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:19.414950 6636 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:19.441983 5554 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:19.404454 7634 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.455610 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.414901 5663 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:19.347476 7810 consensus_queue.cc:260] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.477756 5543 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:19.446395 7835 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.438373 7753 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:19.476348 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 92538.9us
I20260807 13:33:19.484100 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.448892 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:19.451399 7278 raft_consensus.cc:686] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:19.491961 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:19.506600 5543 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:19.412616 7823 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.457998 7682 raft_consensus.cc:686] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:19.471875 7740 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.436872 7816 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.463790 7756 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.511337 5722 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.520581 7808 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260807 13:33:19.503232 7645 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:19.454212 7289 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.527715 5722 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.482643 7832 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.531881 5543 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:19.453848 7499 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.509615 7592 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:19.451855 7657 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.536131 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:19.537523 5543 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:19.548069 7657 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.548950 5499 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:19.550858 5722 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.462344 7799 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.550024 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:19.483945 7634 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.562171 5666 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:19.518853 7835 consensus_queue.cc:1035] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260807 13:33:19.564393 7835 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.564829 7835 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:33:19.524297 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 119224us
I20260807 13:33:19.565203 7835 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.534659 7816 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.516933 7426 consensus_queue.cc:1035] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260807 13:33:19.531522 7632 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.523689 6637 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:19.555137 7654 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.582238 7634 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.523175 7682 consensus_queue.cc:237] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.599090 7592 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:19.599718 7592 raft_consensus.cc:686] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:19.600773 7592 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:19.567544 7758 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.523877 7823 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.581893 7289 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.583406 7632 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.586268 7578 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.588481 7654 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.607268 7653 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.616789 7653 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.619681 7653 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.628849 5543 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:19.630029 5722 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.630558 7808 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.631107 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.631763 5543 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:19.631414 7808 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.632815 5722 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.633672 7578 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:19.633816 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.634580 5543 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:19.634797 7289 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.635316 7289 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.635406 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.635855 5722 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.635888 7289 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.637403 7808 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.638341 7808 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:19.638859 7808 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.634557 7578 raft_consensus.cc:686] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:19.592165 7714 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.645056 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.587231 7753 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:19.653138 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 260617us
I20260807 13:33:19.622372 7632 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.622287 7654 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:19.657410 7834 log.cc:924] Time spent T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.083s user 0.001s sys 0.001s
I20260807 13:33:19.576366 7278 consensus_queue.cc:237] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.663729 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:19.622329 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 121933us
I20260807 13:33:19.664577 5548 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:19.670979 5722 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.661041 5618 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:19.660830 5721 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.674635 5618 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:19.641830 7808 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:19.677016 5618 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:19.690239 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:19.692340 5767 raft_consensus.cc:2396] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260807 13:33:19.569119 7799 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.694331 7758 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260807 13:33:19.694917 7827 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.699240 5552 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:19.698702 7827 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.701732 7827 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.694893 7719 consensus_queue.cc:1046] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260807 13:33:19.677444 7753 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:19.688745 7701 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:33:19.699409 7666 consensus_meta.cc:287] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.684s user 0.012s sys 0.003s
I20260807 13:33:19.677731 7714 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:19.734411 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:19.735165 5763 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:19.709277 7634 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.704087 7499 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.674494 7578 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:19.741089 5618 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:19.746500 5618 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:19.715777 7701 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:19.751297 7701 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:19.740029 7714 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260807 13:33:19.715898 7758 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260807 13:33:19.746255 7719 raft_consensus.cc:3032] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:19.764809 7719 raft_consensus.cc:729] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:19.727450 7842 log.cc:924] Time spent T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.051s user 0.000s sys 0.001s
W20260807 13:33:19.758462 7843 log.cc:924] Time spent T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.135s user 0.001s sys 0.000s
I20260807 13:33:19.758550 7714 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:19.759512 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
W20260807 13:33:19.741757 7844 log.cc:924] Time spent T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.102s user 0.001s sys 0.000s
I20260807 13:33:19.752238 7823 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.726613 7841 consensus_queue.cc:1046] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260807 13:33:19.723496 7666 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:19.795135 5767 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:19.756158 7645 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.756542 7657 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:19.795929 5767 raft_consensus.cc:595] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:19.790594 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 58) took 1306 ms. Trace:
I20260807 13:33:19.815725 5545 rpcz_store.cc:276] 0807 13:33:18.472563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:18.472707 (+ 144us) service_pool.cc:227] Handling call
0807 13:33:18.484030 (+ 11323us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:18.484343 (+ 313us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:18.484381 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:18.503825 (+ 19444us) log.cc:842] Serialized 26 byte log entry
0807 13:33:18.909860 (+406035us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b180032ce00. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff681ff75bb 00007ff681ffd063 00007ff681ffd411 00007ff68234a5cf
0807 13:33:19.282726 (+372866us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:33:19.314090 (+ 31364us) log.cc:842] Serialized 14 byte log entry
0807 13:33:19.328371 (+ 14281us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:19.328463 (+ 92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:19.568326 (+239863us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b180032ce00. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:33:19.634450 (+ 66124us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b180032ce00. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:33:19.778512 (+144062us) raft_consensus.cc:1671] finished
0807 13:33:19.778540 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:19.778692 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13975,"prepare.queue_time_us":34966,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4466,"raft.queue_time_us":20645,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":4666,"spinlock_wait_cycles":72913920,"thread_start_us":372708,"threads_started":1,"wal-append.queue_time_us":818637}
I20260807 13:33:19.816776 7740 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.818897 5544 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:19.820403 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.821250 5544 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:19.702594 7799 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.826356 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.827734 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.828426 5545 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:19.709074 7836 consensus_queue.cc:1046] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260807 13:33:19.831243 5618 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:19.741766 7634 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.849339 5555 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:19.756736 7832 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.763142 7499 consensus_queue.cc:1046] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260807 13:33:19.865667 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.867653 5545 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:19.769554 7852 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.869298 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:19.747396 7753 consensus_queue.cc:1046] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260807 13:33:19.875661 5722 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.831661 7645 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.878453 5763 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:19.830933 7657 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.890376 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.868072 7816 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.881572 7645 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.881220 7657 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:19.765883 7719 consensus_queue.cc:260] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.892460 7758 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:33:19.930066 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 59472.6us
I20260807 13:33:19.911101 5761 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 13:33:19.908010 7758 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:19.901060 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.913059 7736 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:19.947894 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 858) took 1310 ms. Trace:
I20260807 13:33:19.948282 5542 rpcz_store.cc:276] 0807 13:33:18.637586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:19.053952 (+416366us) service_pool.cc:227] Handling call
0807 13:33:19.067007 (+ 13055us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:19.483123 (+416116us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:19.947681 (+464558us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54001d38d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:19.947838 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":827280128}
I20260807 13:33:19.950168 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:19.950172 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:19.952211 7847 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.952697 7847 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:19.953184 7847 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.927820 7719 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:19.969502 5544 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:19.975288 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.961743 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:19.976783 5542 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:19.963027 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:19.978677 5722 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:19.989063 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:19.951382 7758 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:19.985244 7855 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:20.021099 7766 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:20.044792 7634 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:19.888665 7852 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:20.047808 7677 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:20.048623 7677 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.049320 7852 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:20.045933 7766 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.986183 7669 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:19.979774 7816 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:20.057389 7289 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.067545 7701 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.072690 7373 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:19.990783 7784 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:19.997222 7770 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:19.966704 7832 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260807 13:33:19.998944 7740 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:19.999105 7666 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:20.088161 7657 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:19.969193 7736 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.115505 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 751) took 1647 ms. Trace:
I20260807 13:33:20.125679 5771 raft_consensus.cc:2379] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:20.075420 7742 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:20.077255 7669 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:20.199379 5553 rpcz_store.cc:276] 0807 13:33:18.442942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:18.443085 (+ 143us) service_pool.cc:227] Handling call
0807 13:33:20.090066 (+1646981us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003976d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:20.090748 (+ 682us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2581200768}
I20260807 13:33:20.105612 7665 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:20.236349 7756 consensus_meta.cc:287] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.700s user 0.010s sys 0.008s
I20260807 13:33:20.239996 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:20.240914 5553 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
W20260807 13:33:20.138321 7659 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.731s user 0.027s sys 0.046s
I20260807 13:33:20.105640 7816 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.200429 7740 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:20.111159 7373 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:20.237038 7756 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.227543 7669 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:20.273350 7766 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:20.269811 7659 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.862s user 0.027s sys 0.046s
W20260807 13:33:20.277905 7808 consensus_meta.cc:287] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.594s user 0.008s sys 0.003s
I20260807 13:33:20.224483 7742 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.301620 5543 raft_consensus.cc:2379] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:20.305428 7810 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:20.307868 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:20.271231 7677 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.242272 7665 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.315492 5545 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:20.323642 7665 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.287689 7740 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:20.351158 7654 consensus_meta.cc:287] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.681s user 0.006s sys 0.006s
I20260807 13:33:20.360239 7756 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.328156 7736 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.301968 7808 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.374487 5769 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:20.375000 7289 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.362912 7654 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:20.372756 7827 consensus_meta.cc:287] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.670s user 0.012s sys 0.006s
I20260807 13:33:20.375176 7808 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.371533 7373 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:20.377920 7654 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.384112 5554 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:20.383702 7827 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.389153 7827 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.377851 7742 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.367776 7701 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.402503 7827 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:20.403292 7632 consensus_meta.cc:287] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.736s user 0.011s sys 0.002s
I20260807 13:33:20.368075 7756 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:20.386072 7816 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.413367 7827 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:20.424961 7827 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:20.399775 7740 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:20.438833 6636 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.836s user 0.029s sys 0.063s
W20260807 13:33:20.439278 6636 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.837s user 0.029s sys 0.063s
I20260807 13:33:20.440060 7866 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260807 13:33:20.449260 5665 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s user 0.026s sys 0.055s
W20260807 13:33:20.449640 5665 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s user 0.026s sys 0.055s
W20260807 13:33:20.430142 5663 consensus_meta.cc:287] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.930s user 0.014s sys 0.000s
I20260807 13:33:20.410948 7657 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.457650 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 877) took 1045 ms. Trace:
I20260807 13:33:20.460537 5554 rpcz_store.cc:276] 0807 13:33:19.412091 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:19.483861 (+ 71770us) service_pool.cc:227] Handling call
0807 13:33:20.457462 (+973601us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54000221d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:20.457586 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2046352256}
I20260807 13:33:20.421449 7812 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:20.476450 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 881) took 1077 ms. Trace:
W20260807 13:33:20.454228 7700 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.963s user 0.026s sys 0.078s
I20260807 13:33:20.477772 5665 rpcz_store.cc:276] 0807 13:33:19.384282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:19.384393 (+ 111us) service_pool.cc:227] Handling call
0807 13:33:19.384659 (+ 266us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:19.384829 (+ 170us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:19.620662 (+235833us) log.cc:842] Serialized 14 byte log entry
0807 13:33:20.460083 (+839421us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:20.460138 (+ 55us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:20.460196 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:20.460273 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:20.461303 (+ 1030us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2083,"prepare.queue_time_us":611611,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":1041044,"threads_started":2}
I20260807 13:33:20.448765 7756 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.500602 7816 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:20.413813 7847 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.510722 5554 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:20.417446 7632 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.473737 7418 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:20.519001 5389 catalog_manager.cc:5495] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:20.475908 5663 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:20.541232 5390 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51228 (request call id 181) took 4318 ms. Trace:
I20260807 13:33:20.545099 5556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 61) took 1810 ms. Trace:
I20260807 13:33:20.545300 7861 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:33:20.542379 7700 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.060s user 0.026s sys 0.079s
I20260807 13:33:20.501111 7812 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.556368 7418 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:20.579195 5762 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:20.560953 5556 rpcz_store.cc:276] 0807 13:33:18.734839 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:19.241257 (+506418us) service_pool.cc:227] Handling call
0807 13:33:19.258160 (+ 16903us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:19.301633 (+ 43473us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:19.301675 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:19.308145 (+ 6470us) log.cc:842] Serialized 26 byte log entry
0807 13:33:19.625055 (+316910us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b18003cbc80. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff681ff75bb 00007ff681ffd063 00007ff681ffd411 00007ff68234a5cf
0807 13:33:19.947048 (+321993us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:33:19.986364 (+ 39316us) log.cc:842] Serialized 14 byte log entry
0807 13:33:19.986579 (+ 215us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:19.986646 (+ 67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:20.363639 (+376993us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b18003cbc80. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:33:20.544892 (+181253us) raft_consensus.cc:1671] finished
0807 13:33:20.544913 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:20.545043 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":71604,"prepare.queue_time_us":38782,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":55428,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":18607,"spinlock_wait_cycles":20776448,"thread_start_us":320779,"threads_started":1,"wal-append.queue_time_us":1210286}
I20260807 13:33:20.559405 5389 catalog_manager.cc:5495] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:20.590792 5389 catalog_manager.cc:5495] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:20.593344 5389 catalog_manager.cc:5495] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:20.559844 5390 rpcz_store.cc:276] 0807 13:33:16.215542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:16.215730 (+ 188us) service_pool.cc:227] Handling call
0807 13:33:20.533830 (+4318100us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:18.223341 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:18.223915 (+ 574us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:18.223944 (+ 29us) write_op.cc:435] Acquired schema lock
0807 13:33:18.223954 (+ 10us) tablet.cc:660] Decoding operations
0807 13:33:18.224584 (+ 630us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:18.224628 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:18.224644 (+ 16us) tablet.cc:683] Acquiring locks for 7 operations
0807 13:33:18.225007 (+ 363us) tablet.cc:699] Row locks acquired
0807 13:33:18.225018 (+ 11us) write_op.cc:260] PREPARE: finished
0807 13:33:18.225113 (+ 95us) write_op.cc:270] Start()
0807 13:33:18.225195 (+ 82us) write_op.cc:276] Timestamp: P: 1786109598225081 usec, L: 0
0807 13:33:18.225211 (+ 16us) op_driver.cc:331] REPLICATION: starting
0807 13:33:18.335053 (+109842us) log.cc:842] Serialized 3105 byte log entry
0807 13:33:18.775507 (+440454us) op_driver.cc:444] REPLICATION: finished
0807 13:33:19.330762 (+555255us) write_op.cc:301] APPLY: starting
0807 13:33:19.339760 (+ 8998us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:19.404174 (+ 64414us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:19.437586 (+ 33412us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:19.517439 (+ 79853us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:19.555116 (+ 37677us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0807 13:33:19.560605 (+ 5489us) write_op.cc:312] APPLY: finished
0807 13:33:19.594649 (+ 34044us) log.cc:842] Serialized 58 byte log entry
0807 13:33:19.594971 (+ 322us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:19.595125 (+ 154us) write_op.cc:454] Released schema lock
0807 13:33:19.595207 (+ 82us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:19.595693 (+ 486us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:19.595739 (+ 46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73798,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":513462,"apply.run_cpu_time_us":6582,"apply.run_wall_time_us":275142,"num_ops":7,"prepare.queue_time_us":266400,"prepare.run_cpu_time_us":3205,"prepare.run_wall_time_us":126222,"replication_time_us":545111,"thread_start_us":647703,"threads_started":2}]]}
I20260807 13:33:20.604039 7524 raft_consensus.cc:3032] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:20.604686 7524 raft_consensus.cc:729] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:20.606374 7812 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.596395 7418 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.609081 7847 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.609120 7418 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.605852 7524 consensus_queue.cc:260] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:20.613902 6681 consensus_meta.cc:287] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 1.109s user 0.009s sys 0.007s
I20260807 13:33:20.616070 7632 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.594308 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 888) took 1189 ms. Trace:
I20260807 13:33:20.616814 5663 rpcz_store.cc:276] 0807 13:33:19.390021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:19.390198 (+ 177us) service_pool.cc:227] Handling call
0807 13:33:20.562917 (+1172719us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:20.618733 7722 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:20.619354 7722 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:20.629140 7835 consensus_meta.cc:287] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.061s user 0.011s sys 0.008s
I20260807 13:33:20.578989 7861 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:20.635627 7861 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:20.545197 7816 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.590081 7657 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:20.611543 7756 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.646795 7657 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.648375 7524 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:20.655920 7816 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.579988 7784 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:20.656978 7784 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.659240 7784 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:20.661461 7758 consensus_meta.cc:287] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.606s user 0.004s sys 0.010s
I20260807 13:33:20.662190 7758 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:20.666965 7645 consensus_meta.cc:287] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.757s user 0.012s sys 0.000s
I20260807 13:33:20.667524 7645 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.669726 7669 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.639879 7835 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.675366 5764 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:20.680094 7722 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.681268 7722 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:20.710834 7722 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.714437 7722 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:20.642030 7719 consensus_meta.cc:287] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.667s user 0.000s sys 0.014s
I20260807 13:33:20.707265 7758 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:20.708146 7669 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.710222 7645 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.720860 7645 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:20.721702 7632 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:20.721657 7645 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:20.722411 7632 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.724817 7632 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.724977 7645 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:20.687206 7657 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:20.677696 7835 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:20.727664 5721 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.053s user 0.020s sys 0.045s
W20260807 13:33:20.728044 5721 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.054s user 0.020s sys 0.045s
W20260807 13:33:20.728441 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 1.05424e+06us
I20260807 13:33:20.729310 5721 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:20.745784 5621 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.972s user 0.025s sys 0.036s
W20260807 13:33:20.746236 5621 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.972s user 0.025s sys 0.036s
W20260807 13:33:20.753947 5548 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s user 0.038s sys 0.031s
W20260807 13:33:20.754364 5548 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s user 0.038s sys 0.031s
W20260807 13:33:20.732021 7752 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.454s user 0.033s sys 0.066s
W20260807 13:33:20.756243 7752 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.484s user 0.034s sys 0.066s
W20260807 13:33:20.769261 7774 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.451s user 0.007s sys 0.024s
I20260807 13:33:20.732185 7873 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:33:20.770957 7774 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.467s user 0.007s sys 0.024s
W20260807 13:33:20.776120 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 45404.1us
W20260807 13:33:20.772369 7578 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s user 0.015s sys 0.018s
W20260807 13:33:20.775381 7368 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.089s user 0.019s sys 0.034s
I20260807 13:33:20.772114 7722 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:20.795406 5721 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:20.798214 7578 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s user 0.015s sys 0.018s
W20260807 13:33:20.799533 7368 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.118s user 0.019s sys 0.034s
W20260807 13:33:20.824975 7592 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.945s user 0.005s sys 0.034s
I20260807 13:33:20.855894 5770 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:20.775772 7865 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260807 13:33:20.822520 7657 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader election won for term 2
W20260807 13:33:20.857378 7592 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s user 0.005s sys 0.035s
I20260807 13:33:20.843887 7722 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:20.887630 7682 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.996s user 0.002s sys 0.061s
I20260807 13:33:20.889092 7657 raft_consensus.cc:686] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:20.907541 6680 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:20.907354 7847 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:20.899453 7758 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:20.922070 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.958s user 0.004s sys 0.021s
W20260807 13:33:20.922475 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.959s user 0.005s sys 0.021s
W20260807 13:33:20.915346 7779 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.310s user 0.027s sys 0.038s
W20260807 13:33:20.914553 7682 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s user 0.002s sys 0.062s
W20260807 13:33:20.939823 7779 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.348s user 0.027s sys 0.038s
W20260807 13:33:20.989796 5725 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.308s user 0.012s sys 0.020s
I20260807 13:33:20.965816 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:21.004101 5769 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:20.981381 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:20.965418 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:21.004052 5725 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.322s user 0.012s sys 0.021s
I20260807 13:33:20.997567 5767 raft_consensus.cc:1261] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:21.005672 5764 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
W20260807 13:33:20.978040 5618 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.102s user 0.021s sys 0.040s
W20260807 13:33:20.956399 7853 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.050s user 0.020s sys 0.048s
W20260807 13:33:20.926636 7278 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.941s user 0.018s sys 0.034s
W20260807 13:33:21.003172 7753 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.094s user 0.014s sys 0.018s
W20260807 13:33:20.997207 7499 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.107s user 0.007s sys 0.020s
I20260807 13:33:21.009248 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:21.021034 5763 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:33:21.018584 7753 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.129s user 0.014s sys 0.018s
I20260807 13:33:21.005210 5771 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:21.012822 5770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47820 (request call id 72) took 1025 ms. Trace:
I20260807 13:33:21.015407 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:20.925345 7865 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:20.912910 7861 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:21.009034 5618 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.133s user 0.021s sys 0.041s
I20260807 13:33:20.947805 5620 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:21.008136 7862 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:21.034859 7862 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.036760 7578 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:21.024636 5770 rpcz_store.cc:276] 0807 13:33:19.987814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:19.988204 (+ 390us) service_pool.cc:227] Handling call
0807 13:33:19.988537 (+ 333us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:20.857842 (+869305us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:21.012507 (+154665us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54001f1154. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:21.012756 (+ 249us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1994238720}
W20260807 13:33:21.017973 7853 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.111s user 0.023s sys 0.049s
W20260807 13:33:21.029093 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 1.19783e+06us
W20260807 13:33:20.960347 7714 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.127s user 0.011s sys 0.019s
W20260807 13:33:21.033470 7869 log.cc:924] Time spent T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.115s user 0.000s sys 0.000s
I20260807 13:33:21.023435 7657 consensus_queue.cc:237] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.036900 7862 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:21.018417 7278 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s user 0.022s sys 0.037s
I20260807 13:33:20.956267 7645 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:20.925689 7836 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.024s user 0.013s sys 0.017s
I20260807 13:33:20.997318 7784 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:21.024281 7499 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.135s user 0.008s sys 0.021s
I20260807 13:33:21.038218 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:21.048138 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 100448us
I20260807 13:33:20.930579 7758 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.037456 7578 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.101219 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.102069 5666 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:21.050783 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:20.927408 7847 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:20.958971 7682 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:21.103716 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:21.047364 7714 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.232s user 0.013s sys 0.019s
I20260807 13:33:21.072839 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 873) took 1663 ms. Trace:
I20260807 13:33:21.037798 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:21.045162 7756 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:21.104478 5666 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:21.106479 5763 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:21.084411 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:21.062516 5616 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.050s user 0.012s sys 0.023s
I20260807 13:33:21.106192 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.100734 7816 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:21.118325 5665 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:21.117902 5770 raft_consensus.cc:2354] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
W20260807 13:33:21.099645 7836 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.218s user 0.014s sys 0.019s
I20260807 13:33:21.107735 5620 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:21.119045 5616 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.244s user 0.014s sys 0.026s
I20260807 13:33:21.115903 5548 rpcz_store.cc:276] 0807 13:33:19.409940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:19.676690 (+266750us) service_pool.cc:227] Handling call
0807 13:33:19.739953 (+ 63263us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:19.763727 (+ 23774us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:19.763756 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:19.764131 (+ 375us) log.cc:842] Serialized 26 byte log entry
0807 13:33:20.754747 (+990616us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:20.772442 (+ 17695us) log.cc:842] Serialized 14 byte log entry
0807 13:33:20.772645 (+ 203us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:20.772720 (+ 75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:21.004519 (+231799us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b180025efa0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:33:21.072495 (+ 67976us) raft_consensus.cc:1671] finished
0807 13:33:21.072615 (+ 120us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:21.072771 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":18011,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":41,"raft.queue_time_us":22366,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":10129,"spinlock_wait_cycles":2891008,"thread_start_us":928729,"threads_started":1,"wal-append.queue_time_us":1271368}
I20260807 13:33:21.123845 5721 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:21.073570 7722 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.147243 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.152493 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.153079 5666 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
W20260807 13:33:21.050783 5501 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.918s user 0.012s sys 0.033s
I20260807 13:33:21.154698 5620 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:21.154938 5501 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.022s user 0.012s sys 0.033s
W20260807 13:33:21.139927 7817 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.217s user 0.005s sys 0.032s
I20260807 13:33:21.046983 7865 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.106552 7278 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:21.106462 7874 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:21.157466 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:21.152999 7841 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.248s user 0.015s sys 0.024s
I20260807 13:33:21.166920 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:21.126477 5762 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
W20260807 13:33:21.169121 5553 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s user 0.014s sys 0.032s
I20260807 13:33:21.153580 7426 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:21.174798 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:21.175041 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:21.107914 7784 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.074051 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.118877 7682 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:21.249235 5542 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.161s user 0.012s sys 0.031s
I20260807 13:33:21.101574 7645 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:21.249882 5542 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.162s user 0.012s sys 0.031s
I20260807 13:33:21.238281 5765 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:21.180785 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:21.205494 6638 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.795s user 0.012s sys 0.027s
W20260807 13:33:21.251993 6638 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.841s user 0.014s sys 0.028s
I20260807 13:33:21.175738 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:21.252444 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 841932us
W20260807 13:33:21.172765 7817 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.260s user 0.005s sys 0.033s
I20260807 13:33:21.154022 7714 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:21.175408 5555 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s user 0.020s sys 0.025s
I20260807 13:33:21.199568 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:21.257498 5555 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s user 0.020s sys 0.025s
W20260807 13:33:21.241570 5553 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.989s user 0.015s sys 0.032s
I20260807 13:33:21.242005 5764 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:21.210690 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.125859 7816 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.243142 5771 raft_consensus.cc:2396] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:21.249312 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:21.239198 7841 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.367s user 0.016s sys 0.027s
I20260807 13:33:21.155761 6680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57212 (request call id 122) took 1468 ms. Trace:
I20260807 13:33:21.261786 5662 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:21.268966 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:21.271064 5499 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.786s user 0.017s sys 0.020s
I20260807 13:33:21.264822 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:21.277205 5556 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:21.282500 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.283258 5661 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:21.177860 7578 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:21.210692 7862 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:21.287091 5499 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.802s user 0.017s sys 0.020s
I20260807 13:33:21.174786 7753 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:21.290889 5556 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:21.325683 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:21.325851 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:21.291924 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:21.326633 5661 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:21.328889 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:21.329386 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:21.265425 7426 raft_consensus.cc:686] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:21.324877 7753 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:21.332248 7753 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:21.332238 7885 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 13:33:21.332993 7885 consensus_queue.cc:1225] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260807 13:33:21.333803 7885 raft_consensus.cc:3032] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:21.334175 7885 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:21.334955 7885 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:21.336090 7885 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:21.331413 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:21.265591 6636 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.813s user 0.009s sys 0.028s
I20260807 13:33:21.252440 7278 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.127087 7756 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.299368 7418 raft_consensus.cc:3032] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:21.274660 7714 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.299484 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:21.340167 6636 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.898s user 0.010s sys 0.028s
I20260807 13:33:21.299590 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:21.272964 5663 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:21.299752 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:21.300087 7524 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:21.349402 7418 raft_consensus.cc:729] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:21.338815 7841 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:21.354519 7841 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:21.354038 7524 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:21.354882 7841 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:21.354709 7418 consensus_queue.cc:260] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.355727 7418 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:21.302484 7784 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:21.303133 7864 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.183s user 0.001s sys 0.000s
I20260807 13:33:21.356367 7784 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:21.171865 7499 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:21.303615 7836 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:21.304378 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:21.304849 6639 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.885s user 0.012s sys 0.023s
I20260807 13:33:21.307940 5765 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:21.309221 5618 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:21.310030 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:21.312922 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:21.261541 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.315454 5761 raft_consensus.cc:2396] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:21.261032 7592 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:21.261114 7779 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:21.319118 7701 raft_consensus.cc:3032] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:21.319766 7700 raft_consensus.cc:3032] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:21.320458 7856 raft_consensus.cc:3032] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:21.322695 5554 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260807 13:33:21.243430 5474 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.759s user 0.011s sys 0.015s
I20260807 13:33:21.321373 7862 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:21.338581 5543 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s user 0.022s sys 0.022s
W20260807 13:33:21.341313 5552 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.030s user 0.034s sys 0.015s
I20260807 13:33:21.298839 5548 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
W20260807 13:33:21.457432 5543 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s user 0.022s sys 0.022s
W20260807 13:33:21.270910 6637 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.375s user 0.013s sys 0.026s
I20260807 13:33:21.350405 5661 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:21.340226 7758 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.347430 7861 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:21.303946 7879 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.123s user 0.000s sys 0.000s
I20260807 13:33:21.356913 7784 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.357230 7499 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:21.372217 5662 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:21.378472 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:21.382449 5545 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.954s user 0.018s sys 0.028s
W20260807 13:33:21.476106 5545 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s user 0.018s sys 0.028s
I20260807 13:33:21.403157 5556 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
W20260807 13:33:21.370415 6639 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.019s user 0.013s sys 0.023s
I20260807 13:33:21.254557 7874 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:21.472155 7897 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:21.456233 7856 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:21.453593 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 144465us
I20260807 13:33:21.499325 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:21.500028 7758 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:21.500181 5618 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:21.500420 7758 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:21.500800 7758 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:21.501030 5618 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
W20260807 13:33:21.357591 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 916024us
I20260807 13:33:21.503710 7899 raft_consensus.cc:2741] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:33:21.504357 7899 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:21.504660 7856 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.504681 7899 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:21.505996 7856 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:21.506314 7899 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:21.458350 5552 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.147s user 0.034s sys 0.015s
I20260807 13:33:21.373464 7847 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:21.460552 7892 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:21.408211 7701 raft_consensus.cc:729] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:21.461757 7862 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.365137 7836 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.469659 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:21.407681 7855 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.335s user 0.011s sys 0.037s
W20260807 13:33:21.537465 7855 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.491s user 0.011s sys 0.038s
I20260807 13:33:21.537762 7855 raft_consensus.cc:686] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:21.465632 5474 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.982s user 0.011s sys 0.015s
W20260807 13:33:21.465831 6637 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.585s user 0.013s sys 0.026s
I20260807 13:33:21.509455 7897 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:21.544672 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 1.67935e+06us
I20260807 13:33:21.545261 7753 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.546064 7897 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:21.547516 7784 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.503724 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.472949 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:21.552940 5661 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:21.520618 7892 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:33:21.408813 6681 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s user 0.017s sys 0.031s
I20260807 13:33:21.406451 7883 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:21.478228 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.478572 5556 raft_consensus.cc:1261] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:21.408049 7832 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:21.275506 6680 rpcz_store.cc:276] 0807 13:33:19.678651 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:19.688853 (+ 10202us) service_pool.cc:227] Handling call
0807 13:33:19.719406 (+ 30553us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:20.925651 (+1206245us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:21.120100 (+194449us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54005a4954. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:21.146848 (+ 26748us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2692271488}
I20260807 13:33:21.454808 7700 raft_consensus.cc:729] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:21.474447 7632 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:21.365284 7817 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:21.411158 5656 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:21.480068 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:21.571919 5554 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:21.467833 7524 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:21.518280 5662 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:21.478387 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:21.458691 7779 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:21.453675 7592 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:21.480705 7865 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:21.539222 5548 raft_consensus.cc:2396] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 13:33:21.540970 5544 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.261s user 0.002s sys 0.044s
I20260807 13:33:21.550928 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:21.623399 5544 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.344s user 0.002s sys 0.045s
I20260807 13:33:21.549024 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 872) took 1982 ms. Trace:
I20260807 13:33:21.624032 5553 rpcz_store.cc:276] 0807 13:33:19.566724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:20.251187 (+684463us) service_pool.cc:227] Handling call
0807 13:33:20.251580 (+ 393us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:20.251932 (+ 352us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:20.251966 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:20.252591 (+ 625us) log.cc:842] Serialized 26 byte log entry
0807 13:33:21.258337 (+1005746us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:21.258372 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:21.258435 (+ 63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:21.547416 (+288981us) raft_consensus.cc:1671] finished
0807 13:33:21.547548 (+ 132us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:21.548767 (+ 1219us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":43787,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":16077,"thread_start_us":1005385,"threads_started":1,"wal-append.queue_time_us":1293141}
I20260807 13:33:21.383036 7578 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:21.626042 7578 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.486982 7816 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.357632 5666 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 13:33:21.570714 7645 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:21.555676 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:21.555838 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:21.634795 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:21.635376 7893 log.cc:924] Time spent T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.181s user 0.000s sys 0.001s
I20260807 13:33:21.558775 5659 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:21.636452 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.636868 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.637636 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.562244 7832 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:21.481587 7499 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:21.538846 7836 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.548137 7784 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
W20260807 13:33:21.558369 6681 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s user 0.018s sys 0.034s
I20260807 13:33:21.574759 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.666960 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:21.667673 5659 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:21.559038 7892 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:21.555702 7753 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.620307 5661 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:21.635076 6694 raft_consensus.cc:2379] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:21.459904 7426 consensus_queue.cc:237] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.521227 7682 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.573801 7756 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.615684 7714 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.564069 7700 consensus_queue.cc:260] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.615376 7278 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.682780 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:21.685626 7701 consensus_queue.cc:260] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.686954 7701 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:21.623670 7666 raft_consensus.cc:3032] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
W20260807 13:33:21.644448 7368 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.761s user 0.016s sys 0.044s
I20260807 13:33:21.493655 7900 consensus_queue.cc:1046] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.183s
I20260807 13:33:21.571180 7632 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.700258 5659 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:21.676811 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:21.707944 5661 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:21.564556 7883 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.573503 7817 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.672199 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:21.669869 7816 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:21.573634 7890 consensus_queue.cc:1046] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.102s
I20260807 13:33:21.661923 6688 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:21.677217 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:21.538720 7855 consensus_queue.cc:237] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.682296 6687 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 13:33:21.717505 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:21.691314 7368 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.822s user 0.016s sys 0.045s
I20260807 13:33:21.684170 7756 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:21.691450 7666 raft_consensus.cc:729] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:21.727699 5666 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
W20260807 13:33:21.726082 5389 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.072s user 0.029s sys 0.036s
W20260807 13:33:21.735963 5389 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.082s user 0.029s sys 0.036s
W20260807 13:33:21.735216 5722 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.842s user 0.026s sys 0.085s
W20260807 13:33:21.736780 5722 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.843s user 0.026s sys 0.085s
W20260807 13:33:21.737116 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 852286us
I20260807 13:33:21.713634 7779 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:21.719534 7578 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:21.815981 5722 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:21.816198 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:21.738162 7657 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s user 0.003s sys 0.022s
I20260807 13:33:21.736478 7890 consensus_queue.cc:1225] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer d6b8ccce5b91423b8673ddfbbf2c1b1c log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260807 13:33:21.823740 5722 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:21.824466 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.663s user 0.009s sys 0.020s
W20260807 13:33:21.826876 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.666s user 0.010s sys 0.021s
I20260807 13:33:21.698545 7841 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.740386 7900 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:21.862643 5666 raft_consensus.cc:3032] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:21.816602 7669 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:21.823974 7657 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s user 0.003s sys 0.022s
I20260807 13:33:21.727026 7816 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:21.822973 6680 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260807 13:33:21.885977 7666 consensus_queue.cc:260] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:21.886216 7872 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260807 13:33:21.877417 7832 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:21.874810 5764 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.615s user 0.003s sys 0.023s
W20260807 13:33:21.928506 5764 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.668s user 0.003s sys 0.023s
I20260807 13:33:21.822701 7847 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:21.877305 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 723706us
I20260807 13:33:21.771359 7756 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.827471 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:21.941706 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 428898us
W20260807 13:33:21.887138 5555 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s user 0.004s sys 0.019s
I20260807 13:33:21.889640 5666 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:21.930217 5499 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.606s user 0.008s sys 0.022s
I20260807 13:33:21.862229 7752 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
W20260807 13:33:21.826961 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 87234.4us
W20260807 13:33:21.920054 5771 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.658s user 0.004s sys 0.028s
W20260807 13:33:21.922230 5501 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.654s user 0.013s sys 0.021s
I20260807 13:33:21.922081 5667 raft_consensus.cc:2379] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:21.920039 7669 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.919201 7900 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:21.927184 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:21.970664 5542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.645s user 0.025s sys 0.035s
W20260807 13:33:21.994293 5555 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.670s user 0.005s sys 0.019s
I20260807 13:33:21.993487 5666 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:21.974280 5499 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.650s user 0.008s sys 0.022s
I20260807 13:33:21.979285 5721 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:21.923028 6680 pending_rounds.cc:76] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Aborting all ops after (but not including) 5
W20260807 13:33:22.004418 5545 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.502s user 0.011s sys 0.033s
W20260807 13:33:22.015980 7904 log.cc:924] Time spent T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.346s user 0.000s sys 0.001s
W20260807 13:33:22.005931 5771 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.744s user 0.004s sys 0.028s
I20260807 13:33:21.885023 7897 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:33:22.010663 5660 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s user 0.022s sys 0.024s
W20260807 13:33:22.043550 5660 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.638s user 0.022s sys 0.025s
W20260807 13:33:22.006047 5501 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.738s user 0.014s sys 0.021s
W20260807 13:33:21.930068 7853 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s user 0.018s sys 0.021s
I20260807 13:33:22.008682 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:21.933815 7874 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:22.014876 5542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.730s user 0.026s sys 0.035s
I20260807 13:33:22.052901 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 63) took 2613 ms. Trace:
I20260807 13:33:22.004050 7847 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.053311 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.043332 7897 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:21.994052 7890 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260807 13:33:22.003808 7592 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:21.921592 7719 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:22.025545 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 49179.3us
W20260807 13:33:22.031386 5545 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.529s user 0.012s sys 0.033s
I20260807 13:33:21.887892 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:22.004750 7902 raft_consensus.cc:3032] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:22.024236 7883 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.044486 5771 raft_consensus.cc:1261] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:22.007589 5766 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:22.050530 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.053233 5542 rpcz_store.cc:276] 0807 13:33:19.440004 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:20.002235 (+562231us) service_pool.cc:227] Handling call
0807 13:33:20.051888 (+ 49653us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:20.085350 (+ 33462us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:20.085395 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:20.087369 (+ 1974us) log.cc:842] Serialized 26 byte log entry
0807 13:33:21.250373 (+1163004us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:21.284406 (+ 34033us) log.cc:842] Serialized 14 byte log entry
0807 13:33:22.052528 (+768122us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.052623 (+ 95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:22.052677 (+ 54us) raft_consensus.cc:1671] finished
0807 13:33:22.052695 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.052841 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32922,"prepare.queue_time_us":53208,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":381449,"raft.run_cpu_time_us":2998,"raft.run_wall_time_us":23612,"thread_start_us":1930043,"threads_started":2,"wal-append.queue_time_us":1598748}
I20260807 13:33:22.043007 7632 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:22.019866 5666 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:22.038215 6680 pending_rounds.cc:97] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260807 13:33:22.063026 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:22.044342 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 775928us
I20260807 13:33:22.042620 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:22.031001 7905 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:22.032863 7817 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:22.039008 7657 raft_consensus.cc:2741] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260807 13:33:22.094204 5503 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.666s user 0.031s sys 0.018s
W20260807 13:33:22.145985 5503 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.791s user 0.031s sys 0.021s
I20260807 13:33:22.046056 7714 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:22.079348 5721 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:22.064944 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:22.045936 7278 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:22.045801 7722 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:22.113436 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.087628 7719 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.172189 7905 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:22.173373 7914 log.cc:924] Time spent T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.349s user 0.001s sys 0.001s
I20260807 13:33:22.173951 6687 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:22.174786 7719 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:22.115127 7927 log.cc:924] Time spent T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260807 13:33:22.109264 7835 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:22.115764 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.094566 7938 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:22.118745 7816 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:22.185810 5767 raft_consensus.cc:2379] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:22.088552 7944 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:22.090783 7919 log.cc:924] Time spent T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.168s user 0.000s sys 0.001s
W20260807 13:33:22.047079 7853 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s user 0.025s sys 0.027s
I20260807 13:33:22.122087 7700 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:22.059701 7897 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:22.124187 7847 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:22.125859 7900 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.126680 7784 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:22.210600 7784 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.212802 7499 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:22.141299 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:22.094323 7916 log.cc:924] Time spent T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.188s user 0.001s sys 0.000s
I20260807 13:33:22.213222 7784 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.058665 6681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57224 (request call id 149) took 2643 ms. Trace:
I20260807 13:33:22.214967 6681 rpcz_store.cc:276] 0807 13:33:19.406166 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:19.415577 (+ 9411us) service_pool.cc:227] Handling call
0807 13:33:19.419894 (+ 4317us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:19.420156 (+ 262us) raft_consensus.cc:1520] Early marking committed up to index 4
0807 13:33:20.614407 (+1194251us) log.cc:842] Serialized 14 byte log entry
0807 13:33:21.993995 (+1379588us) log.cc:842] Serialized 14 byte log entry
0807 13:33:22.009428 (+ 15433us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:22.015118 (+ 5690us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:22.019003 (+ 3885us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.022820 (+ 3817us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.043089 (+ 20269us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3405,"prepare.queue_time_us":464273,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":17273,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":28098,"thread_start_us":1263295,"threads_started":2,"wal-append.queue_time_us":1210179}
I20260807 13:33:22.217550 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 886) took 2442 ms. Trace:
I20260807 13:33:22.217913 5543 rpcz_store.cc:276] 0807 13:33:19.774922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:20.420019 (+645097us) service_pool.cc:227] Handling call
0807 13:33:20.420439 (+ 420us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:20.420843 (+ 404us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:20.420880 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:20.447588 (+ 26708us) log.cc:842] Serialized 26 byte log entry
0807 13:33:20.493315 (+ 45727us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4800262758. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff68721d7f1 00007ff6872148e7 00007ff68721477a 00007ff68730895f 00007ff687308627 00007ff68731cb2c 00007ff68731cad8 00007ff68731ca58 00007ff68731ca13 00007ff68731bcbc 00007ff68629dbe6
0807 13:33:21.470635 (+977320us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:21.479272 (+ 8637us) log.cc:842] Serialized 14 byte log entry
0807 13:33:21.479491 (+ 219us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:21.479600 (+ 109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:22.217265 (+737665us) raft_consensus.cc:1671] finished
0807 13:33:22.217365 (+ 100us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.217497 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":10878,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":253947,"raft.run_cpu_time_us":1494,"raft.run_wall_time_us":68549,"spinlock_wait_cycles":4945152,"thread_start_us":959438,"threads_started":1,"wal-append.queue_time_us":1278669}
W20260807 13:33:22.110073 7918 log.cc:924] Time spent T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.242s user 0.000s sys 0.001s
W20260807 13:33:22.159327 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 80075.3us
I20260807 13:33:22.164740 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:22.112951 6680 raft_consensus.cc:2866] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:22.221145 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.222152 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 885) took 2447 ms. Trace:
I20260807 13:33:22.222486 5545 rpcz_store.cc:276] 0807 13:33:19.774574 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:20.384969 (+610395us) service_pool.cc:227] Handling call
0807 13:33:20.411779 (+ 26810us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:20.412153 (+ 374us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:20.412191 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:20.417023 (+ 4832us) log.cc:842] Serialized 26 byte log entry
0807 13:33:21.476489 (+1059466us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:21.502564 (+ 26075us) log.cc:842] Serialized 14 byte log entry
0807 13:33:22.077624 (+575060us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.077717 (+ 93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:22.221953 (+144236us) raft_consensus.cc:1671] finished
0807 13:33:22.221976 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.222085 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6676,"prepare.queue_time_us":27341,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":28,"raft.queue_time_us":331269,"raft.run_cpu_time_us":555,"raft.run_wall_time_us":31836,"thread_start_us":1623204,"threads_started":2,"wal-append.queue_time_us":1308029}
I20260807 13:33:22.166488 7669 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:22.113981 5658 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.224108 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:22.226920 7928 log.cc:924] Time spent T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.122s user 0.000s sys 0.000s
I20260807 13:33:22.170792 7278 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.231921 7278 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.171590 7722 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.233083 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 876) took 2611 ms. Trace:
I20260807 13:33:22.233629 7722 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.172822 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.236171 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:22.176288 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 870) took 2649 ms. Trace:
I20260807 13:33:22.236836 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.237670 5661 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:22.237105 5544 rpcz_store.cc:276] 0807 13:33:19.495350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:20.006874 (+511524us) service_pool.cc:227] Handling call
0807 13:33:20.021320 (+ 14446us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:20.491142 (+469822us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4800262758. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff68721d7f1 00007ff6872148e7 00007ff68721477a 00007ff68730895f 00007ff687308627 00007ff68731cb2c 00007ff68731cad8 00007ff68731ca58 00007ff68731ca13 00007ff68731bcbc 00007ff68629dbe6
0807 13:33:21.623747 (+1132605us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:21.623775 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:21.630419 (+ 6644us) log.cc:842] Serialized 26 byte log entry
0807 13:33:22.030672 (+400253us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:22.030725 (+ 53us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.144278 (+113553us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54003c8cd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:22.144351 (+ 73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:22.144402 (+ 51us) raft_consensus.cc:1671] finished
0807 13:33:22.144419 (+ 17us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.144543 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":25263,"raft.run_cpu_time_us":3180,"raft.run_wall_time_us":186658,"spinlock_wait_cycles":620221696,"thread_start_us":1740469,"threads_started":2,"wal-append.queue_time_us":482863}
I20260807 13:33:22.177335 5763 raft_consensus.cc:2354] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:22.182500 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.239090 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.088167 7902 raft_consensus.cc:729] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:22.239784 5666 raft_consensus.cc:2396] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:22.240695 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:22.240509 7902 consensus_queue.cc:260] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.241212 5666 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.241600 7902 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:22.179422 7714 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.244576 7714 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.178544 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.119364 7949 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:22.195168 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:22.245915 7949 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:22.155166 7841 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.196165 7944 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.247483 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.247937 7949 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:22.200237 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 67942.1us
I20260807 13:33:22.248240 7944 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.207885 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.248610 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.248951 5767 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:22.249109 5501 leader_election.cc:398] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:22.249506 5501 leader_election.cc:401] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 13:33:22.249627 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:22.181177 7955 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:22.239770 5661 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:22.181710 5761 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 13:33:22.263283 7955 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:22.264550 7758 consensus_meta.cc:287] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.763s user 0.010s sys 0.001s
I20260807 13:33:22.265424 7955 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:22.246408 5770 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:22.265043 7758 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.265125 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.267203 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.236825 5771 raft_consensus.cc:2354] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:22.251277 5501 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:22.268795 5661 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:22.269995 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.233423 5555 rpcz_store.cc:276] 0807 13:33:19.621687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:20.306846 (+685159us) service_pool.cc:227] Handling call
0807 13:33:20.307149 (+ 303us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:20.329076 (+ 21927us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:20.329114 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:20.329629 (+ 515us) log.cc:842] Serialized 26 byte log entry
0807 13:33:21.258012 (+928383us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:22.020750 (+762738us) log.cc:842] Serialized 14 byte log entry
0807 13:33:22.020917 (+ 167us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.232717 (+211800us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b54003354d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:22.232759 (+ 42us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:22.232804 (+ 45us) raft_consensus.cc:1671] finished
0807 13:33:22.232898 (+ 94us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.233021 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26672,"prepare.queue_time_us":45807,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":162196,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":16847,"spinlock_wait_cycles":49438464,"thread_start_us":1638645,"threads_started":2,"wal-append.queue_time_us":1241702}
I20260807 13:33:22.255362 5721 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:22.192680 7938 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.272439 5721 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:22.274327 7847 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:22.275058 7847 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:22.275588 7847 raft_consensus.cc:686] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:22.276666 7666 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.276500 7847 consensus_queue.cc:237] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.256582 7756 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.204916 7816 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:22.258971 7967 log.cc:924] Time spent T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.094s user 0.001s sys 0.000s
W20260807 13:33:22.259420 7968 log.cc:924] Time spent T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.088s user 0.002s sys 0.000s
I20260807 13:33:22.278853 7816 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.280325 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.273726 5721 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:22.260288 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 880) took 2618 ms. Trace:
I20260807 13:33:22.282389 5721 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:22.179931 7817 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:33:22.260820 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 264979us
I20260807 13:33:22.251153 7657 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260807 13:33:22.302506 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:22.262648 7701 consensus_meta.cc:287] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.575s user 0.008s sys 0.002s
I20260807 13:33:22.219000 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.266390 5667 raft_consensus.cc:2354] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
W20260807 13:33:22.267457 7892 consensus_meta.cc:287] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.589s user 0.005s sys 0.004s
I20260807 13:33:22.181885 7958 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260807 13:33:22.267599 5658 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:22.250281 7944 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:22.270054 7947 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:22.270192 5501 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:22.317178 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 47078.7us
I20260807 13:33:22.319178 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:22.319711 5667 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.251078 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.320485 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.193075 7835 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:22.284592 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.287503 5771 raft_consensus.cc:1261] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:22.325920 5548 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 13:33:22.325996 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.326763 5556 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:22.327095 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.327804 5548 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.327904 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.328707 5556 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.287549 5666 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:22.331274 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.332587 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.303251 5659 raft_consensus.cc:2379] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:22.281414 5764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47820 (request call id 74) took 1024 ms. Trace:
I20260807 13:33:22.303960 7669 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:33:22.302732 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 282592us
I20260807 13:33:22.333611 5764 rpcz_store.cc:276] 0807 13:33:21.256624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:21.259614 (+ 2990us) service_pool.cc:227] Handling call
0807 13:33:21.259861 (+ 247us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:21.541448 (+281587us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b48002601d8. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff68721d7f1 00007ff6872148e7 00007ff68721477a 00007ff68730895f 00007ff687308627 00007ff68731cb2c 00007ff68731cad8 00007ff68731ca58 00007ff68731ca13 00007ff68731bcbc 00007ff68629dbe6
0807 13:33:21.928871 (+387423us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:21.928902 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:21.929338 (+ 436us) log.cc:842] Serialized 26 byte log entry
0807 13:33:22.108555 (+179217us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:22.108613 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.108696 (+ 83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:22.258886 (+150190us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:22.281236 (+ 22350us) raft_consensus.cc:1671] finished
0807 13:33:22.281254 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.281365 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":40730,"raft.run_cpu_time_us":1794,"raft.run_wall_time_us":240716,"spinlock_wait_cycles":77262848,"thread_start_us":770444,"threads_started":2,"wal-append.queue_time_us":206589}
I20260807 13:33:22.282353 5552 rpcz_store.cc:276] 0807 13:33:19.641955 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:20.310435 (+668480us) service_pool.cc:227] Handling call
0807 13:33:20.310719 (+ 284us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:20.310980 (+ 261us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:20.311005 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:20.311399 (+ 394us) log.cc:842] Serialized 26 byte log entry
0807 13:33:21.508467 (+1197068us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:21.508782 (+ 315us) log.cc:842] Serialized 14 byte log entry
0807 13:33:21.874456 (+365674us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:21.874528 (+ 72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:22.172860 (+298332us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:22.201255 (+ 28395us) raft_consensus.cc:1671] finished
0807 13:33:22.260035 (+ 58780us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.260215 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":889,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":404046,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":14164,"spinlock_wait_cycles":88516480,"thread_start_us":1555721,"threads_started":2,"wal-append.queue_time_us":1408154}
I20260807 13:33:22.306051 5721 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:22.336872 5721 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:22.337633 5721 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:22.202333 7899 consensus_meta.cc:287] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.696s user 0.003s sys 0.008s
I20260807 13:33:22.311887 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.302732 7817 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:22.312879 5662 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:22.249231 6688 consensus_meta.cc:287] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 0.514s user 0.006s sys 0.000s
I20260807 13:33:22.273661 7938 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.302385 7832 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:22.321826 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.348233 5544 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:22.323977 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.350032 5666 raft_consensus.cc:2379] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:22.322412 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.350732 5553 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.314038 7853 raft_consensus.cc:979] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159: : Instructing follower 14f62bf285c448b9b7a21fabd7a5f0bf to start an election
I20260807 13:33:22.340103 5721 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:22.340818 7958 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:22.316666 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 915) took 1010 ms. Trace:
I20260807 13:33:22.341148 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.313802 7892 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.316844 7947 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:22.342192 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.341044 7816 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.355099 5499 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:22.345829 7817 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.394164 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 916) took 1087 ms. Trace:
I20260807 13:33:22.394539 5662 rpcz_store.cc:276] 0807 13:33:21.306294 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:21.677404 (+371110us) service_pool.cc:227] Handling call
0807 13:33:22.393948 (+716544us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54000cf654. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:22.394064 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1441462144}
I20260807 13:33:22.395000 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.395655 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.301846 7897 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.396209 5662 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:22.396953 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:22.397091 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.397505 5765 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:22.399554 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.400149 5660 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:22.355795 7873 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:22.346657 7959 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:22.364529 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.365450 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.366466 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.406445 5666 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:22.407209 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.373355 5548 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:22.378387 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.409027 5552 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.382468 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.343597 7669 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:22.436492 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.386511 7853 raft_consensus.cc:1067] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Signalling peer 14f62bf285c448b9b7a21fabd7a5f0bf to start an election
I20260807 13:33:22.440075 5769 raft_consensus.cc:2379] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:22.385385 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:22.386015 5556 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:22.385677 7832 raft_consensus.cc:686] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:22.345117 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.453624 5721 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:22.456158 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.457615 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.393105 7947 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:22.392117 5553 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:22.464061 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.464314 7835 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:22.464780 5553 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:22.355414 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:22.403141 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 48138.7us
I20260807 13:33:22.346400 6688 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:22.466462 5542 raft_consensus.cc:2454] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:22.409677 5765 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:22.467185 5499 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:22.363711 5544 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:22.468604 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.468833 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.469172 5544 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:22.469091 5499 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:22.467305 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.470312 5542 raft_consensus.cc:2379] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:22.470183 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.401412 7958 raft_consensus.cc:686] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:22.470696 5544 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.411185 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.475240 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.476718 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.412019 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.384210 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.364880 7933 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:22.385426 7905 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.439288 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.440003 7669 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.386801 5545 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.448802 5620 leader_election.cc:398] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:22.494565 5544 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:22.494910 5620 leader_election.cc:401] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 13:33:22.452149 6638 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
W20260807 13:33:22.495405 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 46785us
I20260807 13:33:22.393246 7578 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:22.346885 7899 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.389465 5667 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:22.496232 5620 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:22.496831 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.458444 5556 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:22.461090 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.479030 5548 raft_consensus.cc:2379] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:22.479557 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.465798 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.482681 5499 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:22.486575 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.503286 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.503896 5499 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:22.504101 5544 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.487159 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.409109 7756 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:22.490166 5660 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:22.384233 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.449301 7898 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:22.509912 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.510903 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.512974 5544 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:22.502305 5620 leader_election.cc:398] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:22.504784 5767 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:22.498948 5554 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:22.490166 5656 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:22.384727 5658 rpcz_store.cc:276] 0807 13:33:21.306001 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:21.638054 (+332053us) service_pool.cc:227] Handling call
0807 13:33:21.866991 (+228937us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:22.314949 (+447958us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12251520}
I20260807 13:33:22.521939 5542 raft_consensus.cc:2379] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:22.457644 7873 raft_consensus.cc:686] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:22.500358 5666 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
W20260807 13:33:22.500468 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 48447.5us
I20260807 13:33:22.467185 6688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57212 (request call id 123) took 1196 ms. Trace:
I20260807 13:33:22.525661 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.513125 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.520350 5620 leader_election.cc:401] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260807 13:33:22.578317 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 76132.8us
I20260807 13:33:22.498554 7933 raft_consensus.cc:686] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:22.521098 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.580576 5667 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:22.513217 5659 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:22.582293 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 929) took 1061 ms. Trace:
I20260807 13:33:22.582517 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 930) took 1061 ms. Trace:
I20260807 13:33:22.490059 7816 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:22.486287 7812 raft_consensus.cc:2726] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:22.521136 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:22.489832 7938 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:22.523481 5499 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:22.588902 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:22.501073 7949 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:22.514714 7722 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:22.521039 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:22.570271 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:22.573097 7976 log.cc:924] Time spent T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Append to log took a long time: real 0.189s user 0.001s sys 0.000s
I20260807 13:33:22.604125 7657 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:22.607101 7722 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:22.607581 7722 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:22.607540 7657 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:22.608508 7933 consensus_queue.cc:237] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.609478 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.486054 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.610270 5544 raft_consensus.cc:2379] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:22.609807 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.611294 5544 raft_consensus.cc:1261] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:22.611474 5553 raft_consensus.cc:2379] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:22.583714 5660 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:22.613271 5660 raft_consensus.cc:1226] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:22.614405 5660 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:22.614452 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.615094 5542 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:22.615486 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 897) took 1491 ms. Trace:
I20260807 13:33:22.593660 7890 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:22.615859 5665 rpcz_store.cc:276] 0807 13:33:21.124242 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:21.146997 (+ 22755us) service_pool.cc:227] Handling call
0807 13:33:22.615329 (+1468332us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540026d9d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:22.615439 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3372958464}
I20260807 13:33:22.583297 7816 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:22.616430 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 909) took 1312 ms. Trace:
I20260807 13:33:22.616765 7816 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:22.617161 7949 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.575378 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.574589 6688 rpcz_store.cc:276] 0807 13:33:21.271131 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:21.275595 (+ 4464us) service_pool.cc:227] Handling call
0807 13:33:22.466985 (+1191390us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54005415d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:22.467101 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":570511744}
I20260807 13:33:22.618667 5761 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:22.612128 5544 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:54404
I20260807 13:33:22.499822 7578 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:22.606770 7958 consensus_queue.cc:237] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.620117 7578 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.582748 5667 rpcz_store.cc:276] 0807 13:33:21.520425 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.581359 (+1060934us) service_pool.cc:227] Handling call
0807 13:33:22.581700 (+ 341us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:22.581908 (+ 208us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:22.581943 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:22.581995 (+ 52us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:22.582034 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.582095 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.582234 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:22.590973 5661 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:22.622431 5544 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:33:22.622929 5544 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:22.593576 7832 consensus_queue.cc:237] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.591809 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.583081 5659 rpcz_store.cc:276] 0807 13:33:21.520680 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.581578 (+1060898us) service_pool.cc:227] Handling call
0807 13:33:22.581941 (+ 363us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:22.582159 (+ 218us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:22.582192 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:22.582240 (+ 48us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:22.582281 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.582343 (+ 62us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.582457 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:22.615533 5660 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:22.501312 7278 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:22.514420 7714 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260807 13:33:22.593236 5663 raft_consensus.cc:2354] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3.
I20260807 13:33:22.606587 7873 consensus_queue.cc:237] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.508754 7945 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:22.492852 7955 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:22.589691 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 66355us
I20260807 13:33:22.615096 5618 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:22.692021 5499 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:22.692538 5554 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:22.632472 5544 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:22.679474 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 55463.8us
I20260807 13:33:22.684345 5662 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:22.523793 7900 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:22.653017 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.769603 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.593397 7938 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:22.574996 7905 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:22.622452 7949 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:22.759295 7872 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
I20260807 13:33:22.644760 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.616848 5656 rpcz_store.cc:276] 0807 13:33:21.304243 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:21.633116 (+328873us) service_pool.cc:227] Handling call
0807 13:33:22.616275 (+983159us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b540024c7d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:22.616381 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1574990080}
I20260807 13:33:22.800846 5555 raft_consensus.cc:2379] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:22.760790 7980 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:22.604789 7892 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:22.760933 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 68984us
I20260807 13:33:22.810716 5499 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:22.812433 5499 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:22.627502 7982 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:22.765064 5544 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.776680 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:22.816496 5765 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:22.631795 7898 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:22.626875 7758 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:22.798781 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.803259 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.788342 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.627637 7841 consensus_queue.cc:1035] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.147s
I20260807 13:33:22.792505 7938 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:22.785791 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 170761us
I20260807 13:33:22.945246 5618 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:22.818889 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.819082 5499 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:22.816304 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:22.947095 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:22.866990 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 51590.7us
I20260807 13:33:22.947688 5763 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:22.936421 5554 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:22.948289 6637 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:22.948310 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.935911 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.950449 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.950512 5618 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:22.951109 5544 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:22.951958 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.952711 5544 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:22.953431 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.954037 5554 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:22.935319 5553 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:22.937273 5542 raft_consensus.cc:2379] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:22.949806 5555 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:22.799860 7890 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:33:22.934782 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 113344us
I20260807 13:33:22.815732 7900 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:22.766901 7883 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:22.955135 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 136135us
I20260807 13:33:22.963897 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:22.774597 7955 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:22.959125 5620 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:22.864701 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:22.817597 7897 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:22.864542 7945 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:22.936771 7756 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:22.973981 7958 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:23.048051 7958 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:23.048414 7958 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:23.050614 7657 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:22.972772 7899 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:23.052054 7669 consensus_meta.cc:287] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.542s user 0.010s sys 0.000s
I20260807 13:33:23.052438 7669 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:23.058238 7700 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:23.058696 7700 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:23.059983 5552 consensus_meta.cc:287] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.651s user 0.006s sys 0.001s
I20260807 13:33:23.060295 5552 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:23.060483 7700 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.061141 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:23.061502 7700 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:23.062309 7856 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:23.062172 7700 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:23.062824 7856 raft_consensus.cc:686] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:23.044384 7945 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:23.063721 7945 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:23.063690 7856 consensus_queue.cc:237] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.066167 7700 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:23.067544 7900 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:23.068013 7900 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:23.069761 7900 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:23.074852 7986 log.cc:924] Time spent T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.125s user 0.000s sys 0.000s
W20260807 13:33:23.002121 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 45267.8us
I20260807 13:33:23.079762 5618 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:23.001917 5620 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:22.966899 5499 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:22.967980 7784 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:22.968257 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:22.968369 7981 log.cc:924] Time spent T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.283s user 0.000s sys 0.000s
I20260807 13:33:22.973691 5765 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:22.934644 7892 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:22.821333 7949 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:22.946327 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 928) took 1417 ms. Trace:
W20260807 13:33:23.159029 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 79368.9us
I20260807 13:33:23.159778 5618 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:23.083797 5545 consensus_meta.cc:287] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.589s user 0.004s sys 0.003s
I20260807 13:33:23.160907 5545 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:23.090332 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.954387 7982 raft_consensus.cc:686] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:23.108251 5556 raft_consensus.cc:2379] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
W20260807 13:33:23.109913 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 143077us
W20260807 13:33:23.126451 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 366493us
I20260807 13:33:22.963126 7930 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:23.161749 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.954638 7758 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:23.164458 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:23.166602 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:22.954211 7910 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.155s
I20260807 13:33:23.202653 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:22.941365 7898 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.210891 5555 raft_consensus.cc:1261] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260807 13:33:23.157927 7817 consensus_meta.cc:287] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.747s user 0.008s sys 0.000s
I20260807 13:33:23.216372 7817 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.217707 5770 raft_consensus.cc:2379] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:23.218497 7817 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:23.169459 7784 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:23.212383 7899 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:23.227824 7899 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:23.228303 7899 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:23.230501 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:23.231434 5552 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:23.234874 7982 consensus_queue.cc:237] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.239759 7898 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.158341 5658 rpcz_store.cc:276] 0807 13:33:21.520164 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.589971 (+1069807us) service_pool.cc:227] Handling call
0807 13:33:22.687253 (+ 97282us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:22.762392 (+ 75139us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:22.785050 (+ 22658us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:22.793764 (+ 8714us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:22.807949 (+ 14185us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.817914 (+ 9965us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:22.937817 (+119903us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:23.260344 7955 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.168298 7902 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:23.168814 7965 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:23.158669 7890 raft_consensus.cc:686] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:22.974526 7278 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.235s
I20260807 13:33:23.199676 7666 raft_consensus.cc:2741] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:33:23.205106 7700 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:22.974349 7883 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.233837 5552 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:23.158878 7892 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.208176 7669 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:23.281162 6638 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:23.093729 7756 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:23.269068 7816 consensus_meta.cc:287] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.652s user 0.009s sys 0.000s
W20260807 13:33:23.289462 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 341221us
I20260807 13:33:23.207226 7980 consensus_queue.cc:1046] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
W20260807 13:33:23.276502 5721 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.517s user 0.004s sys 0.014s
W20260807 13:33:23.302171 5721 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.542s user 0.004s sys 0.014s
I20260807 13:33:23.292202 5722 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:23.209538 7900 consensus_queue.cc:1046] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
W20260807 13:33:23.303203 5661 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s user 0.015s sys 0.014s
W20260807 13:33:23.303483 5661 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s user 0.015s sys 0.014s
I20260807 13:33:23.195449 7949 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:23.281939 7955 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:23.310814 5771 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s user 0.003s sys 0.063s
W20260807 13:33:23.317665 5771 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.511s user 0.003s sys 0.064s
W20260807 13:33:23.315747 5721 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.194:42569 timed out after 1.766s (SENT) [suppressed 21 similar messages]
I20260807 13:33:23.312769 5722 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:23.301226 7884 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s user 0.008s sys 0.020s
I20260807 13:33:23.312650 5659 raft_consensus.cc:2932] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:23.303418 7841 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:23.337095 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.348886 5770 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:23.349790 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.338115 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.340456 5722 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:23.350867 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.351581 5770 raft_consensus.cc:2379] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:23.353152 5665 raft_consensus.cc:1226] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 1. Current term is 3. Ops: []
I20260807 13:33:23.353193 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.355751 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.292996 7933 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260807 13:33:23.355865 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:23.324611 7884 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s user 0.009s sys 0.021s
W20260807 13:33:23.358072 5663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 913) took 2052 ms (client timeout 1766 ms). Trace:
I20260807 13:33:23.361409 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:23.362064 5770 raft_consensus.cc:3032] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Stepping down as leader of term 2
W20260807 13:33:23.361644 5663 rpcz_store.cc:269] 0807 13:33:21.305469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:21.408954 (+103485us) service_pool.cc:227] Handling call
0807 13:33:23.347828 (+1938874us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b540007dfd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:23.357988 (+ 10160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2182664576}
I20260807 13:33:23.362483 5770 raft_consensus.cc:729] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:23.361667 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.363229 5770 consensus_queue.cc:260] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.364193 5770 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:23.364082 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.365396 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.310273 7645 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:23.326797 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:23.325314 7991 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:33:23.365965 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 364118us
I20260807 13:33:23.280906 7965 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:23.352389 7632 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:33:23.326216 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 519606us
I20260807 13:33:23.303462 7816 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.277354 7902 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.356319 7980 raft_consensus.cc:3032] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:23.382023 5620 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:23.405411 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 233285us
I20260807 13:33:23.370972 5722 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:23.392812 5770 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:23.361495 7884 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:23.324448 7955 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:23.493592 8010 log.cc:924] Time spent T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.130s user 0.000s sys 0.001s
W20260807 13:33:23.487164 7578 consensus_meta.cc:287] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.867s user 0.009s sys 0.004s
I20260807 13:33:23.380605 8012 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:23.495340 7883 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:23.497371 8014 log.cc:924] Time spent T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.133s user 0.001s sys 0.000s
I20260807 13:33:23.430354 7756 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.396410 7991 raft_consensus.cc:686] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:23.492118 7816 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:23.491977 8011 log.cc:924] Time spent T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.128s user 0.000s sys 0.001s
I20260807 13:33:23.491364 7965 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.550768 7949 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:23.357172 7890 consensus_queue.cc:237] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:23.430970 7892 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.464993 8004 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:23.404274 7980 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:33:23.490473 8000 log.cc:924] Time spent T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.055s user 0.000s sys 0.001s
I20260807 13:33:23.469477 5721 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:23.432569 7722 consensus_meta.cc:287] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.824s user 0.007s sys 0.001s
W20260807 13:33:23.498616 7947 consensus_meta.cc:287] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 1.008s user 0.011s sys 0.000s
W20260807 13:33:23.403919 7944 consensus_meta.cc:287] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 1.083s user 0.007s sys 0.003s
I20260807 13:33:23.419133 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:23.355540 7841 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.382210 7645 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.382256 5766 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:23.418286 5499 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:23.484341 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.417778 7278 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:23.403587 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:23.456820 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 295770us
I20260807 13:33:23.608091 5618 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:23.562219 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.609078 5770 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
W20260807 13:33:23.554910 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 184020us
I20260807 13:33:23.611132 5722 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:23.611552 7645 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:23.612206 7645 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:23.612470 5722 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:23.560851 7853 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:23.570915 8012 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:23.614329 7853 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:23.567378 7905 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:23.614782 7853 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:23.614859 7905 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:23.431380 7938 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.618973 7841 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.619550 7938 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.620188 5548 raft_consensus.cc:1226] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:23.621404 7669 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:23.621814 7669 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:23.600590 7944 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:23.603183 7949 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:23.622859 7949 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:23.603091 7980 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.623168 5770 raft_consensus.cc:1226] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:33:23.623696 7980 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:23.584378 7991 consensus_queue.cc:237] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.623202 7949 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:23.613860 5722 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:23.603869 5766 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260807 13:33:23.592918 7873 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:23.596830 7722 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.585186 8004 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:23.575809 7578 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.612661 7645 raft_consensus.cc:686] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:23.587849 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 118463us
I20260807 13:33:23.614408 8012 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:23.599665 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 181462us
I20260807 13:33:23.622503 7669 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:23.629788 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 210763us
I20260807 13:33:23.636096 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 68) took 1325 ms. Trace:
I20260807 13:33:23.642455 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.689700 5721 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:23.641232 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.639474 5618 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:23.690956 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 77207.8us
I20260807 13:33:23.690646 5659 rpcz_store.cc:276] 0807 13:33:22.310390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.627264 (+316874us) service_pool.cc:227] Handling call
0807 13:33:22.758773 (+131509us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:22.815913 (+ 57140us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:22.815941 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:22.936462 (+120521us) log.cc:842] Serialized 527 byte log entry
0807 13:33:23.312524 (+376062us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:23.391404 (+ 78880us) log.cc:842] Serialized 14 byte log entry
0807 13:33:23.393412 (+ 2008us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:23.393503 (+ 91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:23.492856 (+ 99353us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:23.635788 (+142932us) raft_consensus.cc:1671] finished
0807 13:33:23.635903 (+ 115us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:23.636040 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":63962,"raft.queue_time_us":63778,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":84595,"spinlock_wait_cycles":9573760,"thread_start_us":343089,"threads_started":1,"wal-append.queue_time_us":414893}
I20260807 13:33:23.692683 5722 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:23.694638 5620 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:23.621546 7905 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:23.696269 5543 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
W20260807 13:33:23.639870 7958 consensus_meta.cc:287] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.591s user 0.010s sys 0.000s
I20260807 13:33:23.730492 5771 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:23.716233 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.729301 5721 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:23.763401 5764 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:23.734298 5762 raft_consensus.cc:2379] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:23.733721 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.707263 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:23.764700 5767 raft_consensus.cc:2379] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:23.764780 5765 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 3
W20260807 13:33:23.631963 7945 consensus_meta.cc:287] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.568s user 0.010s sys 0.000s
I20260807 13:33:23.762929 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.773684 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.769459 5721 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:23.769680 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:23.590001 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 127152us
I20260807 13:33:23.703011 7499 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:33:23.703220 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 63851us
I20260807 13:33:23.781769 5618 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:23.771507 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 74246.4us
I20260807 13:33:23.639740 7278 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:33:23.775357 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 494244us
I20260807 13:33:23.775609 5501 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:23.634948 7892 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:23.696022 8004 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:23.689875 7873 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:23.791663 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.730396 7841 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:23.679128 7700 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:23.632404 7944 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:23.640832 7955 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.676384 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:23.677903 7982 raft_consensus.cc:3032] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:23.698144 7897 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:23.786208 5555 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:38210
I20260807 13:33:23.867262 5555 raft_consensus.cc:595] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:23.867594 5555 raft_consensus.cc:603] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:23.697871 7992 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:23.735242 7722 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.735224 7578 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:23.703415 7900 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:23.736025 7994 log.cc:924] Time spent T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.409s user 0.002s sys 0.000s
I20260807 13:33:23.782698 5722 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:23.734072 7905 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.735882 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.773391 7812 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:23.778434 7937 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:23.703831 7426 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:23.832940 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:23.792340 5764 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:23.801251 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:23.931953 5666 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:23.796952 5618 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:23.933373 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 136521us
I20260807 13:33:23.930786 5620 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:23.934424 5618 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:23.935854 5618 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:23.937254 5618 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:23.985927 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:23.863359 7982 raft_consensus.cc:729] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:23.868295 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:23.778580 8029 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:23.815425 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:23.991238 5662 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:23.814996 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:23.995042 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:23.996536 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:23.992791 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:23.997227 5667 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
W20260807 13:33:23.999293 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 62130.8us
I20260807 13:33:24.000202 5618 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:23.596437 7947 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.860209 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:23.861101 7944 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.630044 7853 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:23.783460 7832 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:24.014401 5662 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
W20260807 13:33:23.903424 5543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 892) took 1548 ms (client timeout 1713 ms). Trace:
I20260807 13:33:23.829717 7278 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:23.985756 7426 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:23.829457 7883 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:23.927907 7700 consensus_queue.cc:1046] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260807 13:33:23.837633 7499 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.027199 5660 raft_consensus.cc:2379] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:23.924110 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 141480us
I20260807 13:33:24.031303 5722 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:24.024047 7426 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:23.996963 7949 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.783779 7945 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.987111 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:23.993808 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.072050 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.072531 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.072918 5666 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:24.002451 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.075203 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:24.003082 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 66563us
I20260807 13:33:23.865185 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:23.930590 7992 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:23.928637 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.077191 5658 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:23.788822 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:23.987466 7930 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:23.931339 7937 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:24.078758 7937 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:24.017031 5543 rpcz_store.cc:269] 0807 13:33:22.319581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.320270 (+ 689us) service_pool.cc:227] Handling call
0807 13:33:23.867579 (+1547309us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002b2854. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:23.867690 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2995763456}
I20260807 13:33:24.018455 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.035324 7883 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.082496 5662 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:23.786772 7892 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:24.022148 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.083576 5662 raft_consensus.cc:1226] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:33:24.083791 7892 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.083597 7883 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:23.925041 7900 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.991451 8020 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:24.085600 8020 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:24.085951 8020 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:23.999053 8029 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.025802 5618 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:24.088887 8029 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.089166 7883 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 13:33:24.089293 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 63588.7us
I20260807 13:33:24.090302 7947 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.090566 5618 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:24.091156 7883 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:24.091629 7883 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.092638 5618 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:24.000833 7722 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:24.093349 7722 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.093637 7883 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.093731 7722 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:24.094287 7883 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:33:24.015547 7989 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.936s user 0.001s sys 0.003s
I20260807 13:33:23.999974 8016 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:24.039355 7982 consensus_queue.cc:260] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.012130 7856 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:24.097721 7856 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.097833 7982 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:24.098160 7856 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:24.101029 6687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37838 (request call id 84) took 1756 ms. Trace:
I20260807 13:33:23.872519 7645 consensus_queue.cc:237] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.104110 7900 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.041586 5762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32950 (request call id 971) took 1655 ms. Trace:
I20260807 13:33:24.104808 5762 rpcz_store.cc:276] 0807 13:33:22.382033 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.394787 (+ 12754us) service_pool.cc:227] Handling call
0807 13:33:24.037339 (+1642552us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540020c1d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:24.037456 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3071033728}
I20260807 13:33:24.105983 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.107012 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.015640 7855 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:24.107717 7855 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.986555 7812 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.015403 7832 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:24.110399 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.111505 5656 raft_consensus.cc:2354] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:24.112512 7812 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:24.118294 5658 raft_consensus.cc:1261] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:24.069710 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.058652 7632 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:24.120311 7632 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:24.120836 7632 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.124902 7944 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:24.127769 7980 consensus_meta.cc:287] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.504s user 0.008s sys 0.000s
I20260807 13:33:24.127810 7855 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:24.128655 7899 consensus_meta.cc:287] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.900s user 0.010s sys 0.002s
I20260807 13:33:24.129253 5766 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:24.129171 7899 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.132277 7899 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.132555 7853 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:24.133740 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:24.134593 6688 raft_consensus.cc:2379] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:23.774081 7958 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.136559 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.137526 5766 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:24.137566 7958 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.139097 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:23.793440 7873 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:24.039062 7499 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.060799 7949 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:24.061609 8038 log.cc:924] Time spent T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.131s user 0.000s sys 0.000s
W20260807 13:33:24.062249 8031 log.cc:924] Time spent T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.200s user 0.001s sys 0.000s
I20260807 13:33:24.065958 8012 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:23.857019 5765 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:24.149214 5554 raft_consensus.cc:1226] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 6. Ops: []
I20260807 13:33:24.097280 8016 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.110634 7832 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:24.073956 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.153367 5666 raft_consensus.cc:2379] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:24.140666 5620 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:24.101588 6687 rpcz_store.cc:276] 0807 13:33:22.345079 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.346606 (+ 1527us) service_pool.cc:227] Handling call
0807 13:33:22.375495 (+ 28889us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:22.375913 (+ 418us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 13:33:22.376244 (+ 331us) log.cc:842] Serialized 14 byte log entry
0807 13:33:22.520600 (+144356us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:22.568669 (+ 48069us) log.cc:842] Serialized 26 byte log entry
0807 13:33:22.568808 (+ 139us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:22.568849 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:22.568920 (+ 71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:23.788498 (+1219578us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:24.100605 (+312107us) raft_consensus.cc:1671] finished
0807 13:33:24.100757 (+ 152us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:24.100952 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":2198,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":975,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":12407,"spinlock_wait_cycles":363569408,"thread_start_us":122320,"threads_started":1,"wal-append.queue_time_us":560823}
I20260807 13:33:24.162375 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.163209 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 908) took 1820 ms. Trace:
I20260807 13:33:24.163623 5548 rpcz_store.cc:276] 0807 13:33:22.342832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.506552 (+163720us) service_pool.cc:227] Handling call
0807 13:33:22.506813 (+ 261us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:23.620561 (+1113748us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:24.162936 (+542375us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400022954. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:24.163144 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2560129920}
I20260807 13:33:24.164390 5620 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:24.165448 7883 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:24.166239 7883 raft_consensus.cc:686] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:24.167363 7897 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.167948 7883 consensus_queue.cc:237] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.168646 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.149494 7992 raft_consensus.cc:686] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:24.143620 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 97437.6us
I20260807 13:33:24.176170 5722 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:24.147046 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 54477.3us
I20260807 13:33:24.175678 7992 consensus_queue.cc:237] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.177115 5618 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:23.930932 7955 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:24.178052 7955 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:24.178568 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1261) took 2167 ms. Trace:
I20260807 13:33:24.178633 7955 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:24.179070 5665 rpcz_store.cc:276] 0807 13:33:22.010902 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.617525 (+606623us) service_pool.cc:227] Handling call
0807 13:33:23.352925 (+735400us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:23.353617 (+ 692us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:24.178331 (+824714us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b540007dfd0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:24.178511 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1690617728}
W20260807 13:33:24.184924 8008 log.cc:924] Time spent T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.820s user 0.003s sys 0.000s
I20260807 13:33:24.186476 5763 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:24.188781 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 898) took 1534 ms. Trace:
I20260807 13:33:24.189127 5554 rpcz_store.cc:276] 0807 13:33:22.654752 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:23.208940 (+554188us) service_pool.cc:227] Handling call
0807 13:33:23.209311 (+ 371us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:24.149597 (+940286us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:24.188575 (+ 38978us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b5400397bd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:24.188727 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2161206144}
I20260807 13:33:24.190982 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 65) took 2152 ms. Trace:
I20260807 13:33:24.149724 7855 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:24.191431 5661 rpcz_store.cc:276] 0807 13:33:22.038860 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.624452 (+585592us) service_pool.cc:227] Handling call
0807 13:33:22.624757 (+ 305us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:22.624929 (+ 172us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:22.624952 (+ 23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:22.625332 (+ 380us) log.cc:842] Serialized 26 byte log entry
0807 13:33:23.305411 (+680079us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:23.313371 (+ 7960us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:23.313435 (+ 64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:24.183975 (+870540us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:24.190566 (+ 6591us) raft_consensus.cc:1671] finished
0807 13:33:24.190592 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:24.190898 (+ 306us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26283904,"thread_start_us":679733,"threads_started":1,"wal-append.queue_time_us":739251}
I20260807 13:33:24.196368 7902 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.058796 7841 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:24.155587 8012 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:24.155776 7499 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.155977 7930 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:24.157276 5761 raft_consensus.cc:2379] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:24.157773 8016 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:24.160481 7937 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:24.202947 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 427385us
I20260807 13:33:24.203694 5618 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:24.210309 5722 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:24.225435 7856 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:24.207528 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 348931us
I20260807 13:33:24.239578 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:24.244419 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 465260us
I20260807 13:33:24.205495 7890 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.251227 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.255472 5661 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.257637 5765 raft_consensus.cc:1261] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:24.253006 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.258545 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.207504 7853 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.251441 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.206748 7841 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.148253 7899 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260807 13:33:24.216861 7930 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:24.266763 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.270165 5665 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:24.267246 5765 raft_consensus.cc:2379] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:24.268229 5662 raft_consensus.cc:1261] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:24.148635 7669 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.278198 5501 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:24.270974 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.299135 5665 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:24.293453 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.300897 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.307789 6638 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.309412 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.310273 5763 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.293948 5722 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:24.304456 5499 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.305193 5501 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.319319 5666 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:24.319213 5499 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:24.319522 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 78616.1us
I20260807 13:33:24.321903 5499 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:24.323349 5499 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:24.324385 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.255573 7499 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:24.326809 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.259447 7991 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:24.292140 7930 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.291492 8044 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:24.331645 5499 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.235582 8012 consensus_queue.cc:1035] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260807 13:33:24.332486 5665 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.333874 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.332788 5501 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.330732 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:24.355309 5661 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:24.359834 5764 raft_consensus.cc:1226] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:24.290751 7982 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.292366 5766 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.270761 7841 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.308521 7700 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.375123 5499 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.325527 7865 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:24.376323 5503 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:24.331290 8036 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:24.330595 7722 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.325714 7958 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:24.311584 7998 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:24.328136 7816 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:24.328673 7900 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:24.379601 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:24.388012 5499 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:24.426990 5499 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:24.332667 7980 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:24.309919 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.368208 5663 raft_consensus.cc:2379] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:24.392450 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.383812 7499 consensus_queue.cc:1035] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260807 13:33:24.394675 8043 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.395182 7890 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.395588 7856 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.396901 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.398311 7865 raft_consensus.cc:686] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:24.399219 7902 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:24.364058 7947 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:24.363716 8029 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.443711 7945 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:24.402868 8013 log.cc:924] Time spent T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 1.037s user 0.000s sys 0.013s
I20260807 13:33:24.405807 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.355432 7991 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:24.459088 7991 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:24.459199 8059 log.cc:924] Time spent T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
I20260807 13:33:24.459837 5769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 979) took 1683 ms. Trace:
I20260807 13:33:24.302960 7426 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.371738 7944 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.325801 7897 consensus_queue.cc:1046] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260807 13:33:24.479122 7897 raft_consensus.cc:3032] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:24.479449 7897 raft_consensus.cc:729] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:24.480265 7897 consensus_queue.cc:260] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.481349 7897 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.483659 5761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1271) took 1146 ms. Trace:
I20260807 13:33:24.484807 7426 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:24.443325 7900 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:24.485463 7900 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:24.485786 7900 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:24.489713 5762 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:24.491775 7722 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:24.408399 8004 consensus_meta.cc:287] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 0.566s user 0.005s sys 0.005s
I20260807 13:33:24.463313 7892 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.492865 8004 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:24.496403 8004 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:24.386626 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 53924.5us
I20260807 13:33:24.404271 8017 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:33:24.431730 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 103109us
I20260807 13:33:24.437559 5499 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:24.497809 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 60347.2us
I20260807 13:33:24.497951 5501 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.498895 5499 leader_election.cc:398] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4.
I20260807 13:33:24.499447 5501 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.500785 5499 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:24.434335 6688 raft_consensus.cc:2362] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3. Re-sending same reply.
I20260807 13:33:24.446712 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.450976 7890 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.512960 7949 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:24.513389 7949 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:24.513710 7949 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:24.513752 7890 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.451993 8069 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:24.454861 7865 consensus_queue.cc:237] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.455562 7278 raft_consensus.cc:3032] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:24.521085 5767 raft_consensus.cc:2396] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260807 13:33:24.430545 6680 raft_consensus.cc:1226] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:24.391845 7982 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.434360 7980 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:24.380555 8044 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.435256 7816 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:24.470346 7937 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:24.470793 7669 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:24.473196 8012 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:24.514739 7945 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.475391 8020 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:24.476861 7832 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:24.477831 7947 raft_consensus.cc:686] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:24.527402 7816 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.546627 7816 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.546211 7947 consensus_queue.cc:237] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.523128 7278 raft_consensus.cc:729] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:24.489531 7632 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.523427 5656 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:24.540799 6685 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:24.552063 7632 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:24.500810 5501 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:24.553648 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 52876.6us
I20260807 13:33:24.460196 5769 rpcz_store.cc:276] 0807 13:33:22.776576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:22.777913 (+ 1337us) service_pool.cc:227] Handling call
0807 13:33:22.807112 (+ 29199us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:22.943753 (+136641us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:22.943796 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:22.953611 (+ 9815us) log.cc:842] Serialized 26 byte log entry
0807 13:33:23.292845 (+339234us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:23.292882 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:23.292959 (+ 77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:24.402261 (+1109302us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:24.459515 (+ 57254us) raft_consensus.cc:1671] finished
0807 13:33:24.459536 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:24.459760 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":54942,"raft.queue_time_us":115857,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":12254,"spinlock_wait_cycles":25125120,"thread_start_us":240943,"threads_started":1,"wal-append.queue_time_us":403919}
I20260807 13:33:24.495422 7892 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.508052 7944 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.554620 5501 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:24.507979 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.556020 5501 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:24.556438 7944 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:24.556907 7944 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:24.557258 7944 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:24.509908 7902 consensus_queue.cc:1035] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:24.558470 7832 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:24.511989 7756 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:24.563380 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:24.563606 5771 raft_consensus.cc:1226] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:24.567742 8020 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:24.504101 5499 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:24.404136 7855 consensus_queue.cc:1046] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260807 13:33:24.523854 5763 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:24.422601 7998 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:24.484305 5761 rpcz_store.cc:276] 0807 13:33:23.337349 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:23.348134 (+ 10785us) service_pool.cc:227] Handling call
0807 13:33:24.483394 (+1135260us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b540020a8d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:24.483570 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1255403776}
I20260807 13:33:24.539292 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.470806 5766 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:24.553802 8017 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.588418 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:24.589020 6688 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.526693 7817 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:24.569711 5667 raft_consensus.cc:2379] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:24.570338 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 66322.7us
I20260807 13:33:24.597088 5499 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:24.598387 5499 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:24.596354 5501 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:24.418900 5665 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:24.603140 7945 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:24.524029 8069 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.603653 7945 raft_consensus.cc:686] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:24.604610 7945 consensus_queue.cc:237] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.605494 8069 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.583055 7900 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.616796 7900 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:24.619241 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 192602us
I20260807 13:33:24.522941 7853 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:24.527073 7980 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:24.572242 7756 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:24.579121 7998 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:24.524224 7873 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.577870 6638 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.580992 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:24.583999 5761 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:24.584337 8044 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.585692 7982 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.584635 8016 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.540391 8012 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:24.587633 8008 log.cc:924] Time spent T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
I20260807 13:33:24.602500 5501 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.621495 5499 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.595610 7902 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:24.608067 8029 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:24.633450 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:24.631067 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 53289.4us
I20260807 13:33:24.646595 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.647106 5764 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.628245 7756 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:33:24.647725 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 45304us
I20260807 13:33:24.648660 5501 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.635576 5620 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:24.639209 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.627305 8017 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:24.641844 5765 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.736215 8044 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:24.736647 7841 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.607810 7817 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:24.738734 8077 log.cc:924] Time spent T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.106s user 0.000s sys 0.000s
I20260807 13:33:24.645120 7982 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 13:33:24.738252 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 116849us
I20260807 13:33:24.739972 7944 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.740967 8043 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.741328 7930 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.735244 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.636857 8024 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 13:33:24.753929 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 118421us
I20260807 13:33:24.756783 7756 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.743346 8016 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.645342 7902 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:24.755419 5501 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.760810 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.761238 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.762619 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.760692 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.778167 5660 raft_consensus.cc:2379] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:24.778273 5661 raft_consensus.cc:2379] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:24.765188 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:24.743628 8066 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.124s user 0.000s sys 0.001s
I20260807 13:33:24.771649 5764 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
W20260807 13:33:24.742465 7955 consensus_meta.cc:287] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.563s user 0.008s sys 0.004s
I20260807 13:33:24.742026 6688 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:24.736650 7900 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.759701 8073 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:24.784121 5765 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:24.785177 5620 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:24.784981 5499 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.762815 7700 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.746130 7816 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.772955 8017 raft_consensus.cc:686] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:24.763809 8029 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 13:33:24.790680 5501 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:24.761823 8019 consensus_queue.cc:1046] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260807 13:33:24.854480 8019 raft_consensus.cc:3032] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:24.854858 8019 raft_consensus.cc:729] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:24.850044 7930 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.855626 8019 consensus_queue.cc:260] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:24.856971 8019 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.860385 7980 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.774343 8033 consensus_queue.cc:1046] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260807 13:33:24.782016 7902 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.783267 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.848965 7958 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:24.837142 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.792326 5499 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:24.870875 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:24.864130 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 73508.1us
I20260807 13:33:24.871464 5770 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:24.795470 8044 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:24.795167 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.797839 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.865758 5721 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:24.824676 5658 raft_consensus.cc:1226] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:24.789846 8073 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:24.786255 7938 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:24.823917 7841 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.823472 7873 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:24.792906 8016 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:24.822919 7944 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.891647 5660 raft_consensus.cc:2379] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:24.868448 7900 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:24.786537 7955 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.913729 7991 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.920348 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:24.922282 5769 raft_consensus.cc:1226] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:24.923377 8016 raft_consensus.cc:686] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:24.924309 8016 consensus_queue.cc:237] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:24.925781 7890 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:24.926494 5761 raft_consensus.cc:1226] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:24.926301 7890 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.927349 7980 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.927512 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.928252 7890 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.928802 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.929672 7756 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.886476 7958 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.932173 7756 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.932307 7958 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.887076 7982 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260807 13:33:24.933423 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.891335 7812 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:24.934487 5658 raft_consensus.cc:2354] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:24.935566 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.806864 7700 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.921911 7991 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:24.936448 7817 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:24.907696 8073 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:24.891139 7892 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:24.921851 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.938697 8017 consensus_queue.cc:237] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.938082 5658 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:24.787119 8052 consensus_queue.cc:1046] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.121s
I20260807 13:33:24.917712 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:24.954341 5763 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 5
I20260807 13:33:24.943849 5770 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:24.957407 5764 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:24.957468 5721 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:24.958796 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:24.959128 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 166879us
I20260807 13:33:24.959887 5620 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:24.961022 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.966483 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.967905 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.969317 5721 leader_election.cc:398] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:24.969718 5721 leader_election.cc:401] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 13:33:24.914361 7938 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:24.943676 5663 raft_consensus.cc:2354] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:24.776652 8043 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.975414 5721 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:24.976699 5552 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:38210
I20260807 13:33:24.939419 6688 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 13:33:24.940985 7700 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:24.998565 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:24.952360 7944 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
W20260807 13:33:25.017287 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 106953us
I20260807 13:33:25.010478 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:24.966049 8019 raft_consensus.cc:3032] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:24.966684 7756 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:24.967401 7817 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:25.030763 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:25.031376 5770 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:24.941479 7892 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:24.970779 7812 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:24.971987 7980 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.035336 5763 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:25.025621 5552 raft_consensus.cc:595] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:24.972791 7945 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:25.006004 8052 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:24.940613 7890 consensus_queue.cc:1046] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260807 13:33:25.023350 7841 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.026955 5721 leader_election.cc:398] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:25.037945 5552 raft_consensus.cc:603] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 13:33:25.046157 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 102193us
I20260807 13:33:25.024102 7938 raft_consensus.cc:686] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:25.024911 8019 raft_consensus.cc:729] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:25.022517 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:25.023545 7933 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:25.046161 5721 leader_election.cc:401] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 13:33:25.041244 5770 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:25.047981 8020 raft_consensus.cc:3032] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
W20260807 13:33:25.042748 7949 consensus_meta.cc:287] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.523s user 0.009s sys 0.000s
I20260807 13:33:25.053797 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260807 13:33:25.026511 7944 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.087536 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:25.095768 5659 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:25.041853 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:25.049175 8052 raft_consensus.cc:686] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:25.033975 7756 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.101125 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:25.101913 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:25.041857 7980 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.105187 5663 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:25.105419 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:25.105522 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.050267 7816 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.099999 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:25.055580 7817 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:25.053182 8020 raft_consensus.cc:729] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:25.104713 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:25.109143 5543 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:25.393855 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:25.195770 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 106574us
I20260807 13:33:25.364058 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.364833 8099 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:25.051924 8082 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260807 13:33:25.049154 7841 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:25.368621 6685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37838 (request call id 86) took 1720 ms (client timeout 2007 ms). Trace:
I20260807 13:33:25.368744 6687 raft_consensus.cc:1226] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:25.369212 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:25.369378 5554 raft_consensus.cc:2379] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
W20260807 13:33:25.372427 8083 log.cc:924] Time spent T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.523s user 0.000s sys 0.001s
I20260807 13:33:25.373714 7955 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:25.375836 8085 log.cc:924] Time spent T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.528s user 0.001s sys 0.000s
W20260807 13:33:25.199175 8087 log.cc:924] Time spent T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.142s user 0.000s sys 0.000s
I20260807 13:33:25.045684 7945 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.378072 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.059348 7949 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:25.407790 8088 log.cc:924] Time spent T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.351s user 0.003s sys 0.008s
I20260807 13:33:25.379428 5771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47820 (request call id 88) took 1084 ms. Trace:
I20260807 13:33:25.215029 7938 consensus_queue.cc:237] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.110006 8092 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:25.177201 8019 consensus_queue.cc:260] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.383688 5659 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:25.378631 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.230439 7278 consensus_queue.cc:260] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.395694 5555 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:25.394550 5543 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:25.400471 5552 raft_consensus.cc:2354] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3.
I20260807 13:33:25.408180 5661 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:25.441865 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:25.401386 7902 consensus_meta.cc:287] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.521s user 0.012s sys 0.004s
I20260807 13:33:25.199260 8052 consensus_queue.cc:237] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.370430 7944 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:25.386991 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:25.455017 5771 rpcz_store.cc:276] 0807 13:33:24.295266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.453919 (+158653us) service_pool.cc:227] Handling call
0807 13:33:24.454216 (+ 297us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:24.564146 (+109930us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.379221 (+815075us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400212354. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:25.379379 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":250754304}
I20260807 13:33:25.402549 7900 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:25.482635 5553 raft_consensus.cc:2379] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:25.468040 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.468518 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.483374 5661 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:25.484321 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:25.484586 8104 log.cc:924] Time spent T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.077s user 0.000s sys 0.000s
I20260807 13:33:25.484997 7949 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.485344 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.474504 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:25.486532 5659 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:25.487036 7841 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.406497 7991 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:25.446576 7817 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.478642 5556 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:25.406311 8099 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.488567 5542 raft_consensus.cc:2354] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:25.462883 7955 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.452961 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:25.491022 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.412163 8073 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.497426 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:25.495535 7883 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s user 0.016s sys 0.020s
I20260807 13:33:25.465667 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:25.544440 5763 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 2. Current term is 3. Ops: []
W20260807 13:33:25.492494 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 100039us
W20260807 13:33:25.630518 5658 consensus_meta.cc:287] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.684s user 0.015s sys 0.008s
I20260807 13:33:25.638562 5659 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:25.640126 5660 raft_consensus.cc:2354] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
I20260807 13:33:25.639314 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:25.505393 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:25.640650 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.644624 7949 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:25.618376 5543 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:25.441082 6685 rpcz_store.cc:269] 0807 13:33:23.648368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:23.676031 (+ 27663us) service_pool.cc:227] Handling call
0807 13:33:25.241116 (+1565085us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54004fecd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:25.368569 (+127453us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1471482752}
W20260807 13:33:25.548154 7883 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s user 0.016s sys 0.021s
I20260807 13:33:25.506646 7892 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.496235 7841 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:25.699191 7945 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.698933 7841 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.701381 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:25.703178 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:25.704025 5661 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:25.704353 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:25.705533 5552 raft_consensus.cc:2379] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:25.580813 8012 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:25.460700 8017 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.474613 8020 consensus_queue.cc:260] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.492151 7991 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.496978 8043 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:25.581885 8044 consensus_meta.cc:287] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.690s user 0.008s sys 0.009s
I20260807 13:33:25.732123 5765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1300) took 1473 ms. Trace:
I20260807 13:33:25.732396 8044 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:25.588315 8073 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.547051 8082 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.734431 8082 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.735684 5767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1003) took 1114 ms. Trace:
I20260807 13:33:25.736752 8082 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.720301 5555 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:25.473726 8092 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.563027 8106 consensus_queue.cc:1046] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260807 13:33:25.738651 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.739727 8106 raft_consensus.cc:3032] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:25.740162 8106 raft_consensus.cc:729] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:25.740646 8092 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.741884 5663 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:25.580628 8099 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.741690 8106 consensus_queue.cc:260] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:25.743862 5766 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32950 (request call id 1000) took 1608 ms (client timeout 1683 ms). Trace:
I20260807 13:33:25.744107 8106 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:25.739601 5555 raft_consensus.cc:2362] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 4. Re-sending same reply.
W20260807 13:33:25.744401 5766 rpcz_store.cc:269] 0807 13:33:24.135471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.138742 (+ 3271us) service_pool.cc:227] Handling call
0807 13:33:25.743456 (+1604714us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54003c8a54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:25.743656 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":307378432}
I20260807 13:33:25.491226 6681 raft_consensus.cc:2362] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4. Re-sending same reply.
I20260807 13:33:25.506795 7756 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:25.688717 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.689559 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:25.746362 6681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57212 (request call id 130) took 1480 ms (client timeout 1857 ms). Trace:
I20260807 13:33:25.690416 5548 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:25.582520 7980 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.697815 7892 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:25.483105 7902 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.750869 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.751976 5662 raft_consensus.cc:2379] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:25.736066 5767 rpcz_store.cc:276] 0807 13:33:24.620782 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.620959 (+ 177us) service_pool.cc:227] Handling call
0807 13:33:24.635487 (+ 14528us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:24.782516 (+147029us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:24.782544 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:24.782952 (+ 408us) log.cc:842] Serialized 26 byte log entry
0807 13:33:24.958885 (+175933us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:24.958925 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.734969 (+776044us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540036c9d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:25.735036 (+ 67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:25.735115 (+ 79us) raft_consensus.cc:1671] finished
0807 13:33:25.735129 (+ 14us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:25.735483 (+ 354us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7282,"raft.queue_time_us":7382,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6970,"spinlock_wait_cycles":320541440,"thread_start_us":98352,"threads_started":1,"wal-append.queue_time_us":230659}
I20260807 13:33:25.752900 7902 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.753073 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.705668 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.708150 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:25.711184 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48804 (request call id 71) took 1851 ms. Trace:
I20260807 13:33:25.687322 5658 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:25.755538 5544 raft_consensus.cc:2379] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:25.755435 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:25.756496 5548 raft_consensus.cc:2354] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3.
I20260807 13:33:25.756407 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:25.756984 5769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1005) took 1134 ms. Trace:
I20260807 13:33:25.497308 7955 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.757540 5769 rpcz_store.cc:276] 0807 13:33:24.622173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.622890 (+ 717us) service_pool.cc:227] Handling call
0807 13:33:24.632800 (+ 9910us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:24.922662 (+289862us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.738005 (+815343us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54001f0754. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:25.756771 (+ 18766us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":665260288}
I20260807 13:33:25.718334 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:25.759610 6680 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:25.684695 8113 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:25.760757 7892 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.760977 8113 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.719882 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:25.717873 7949 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.732556 5765 rpcz_store.cc:276] 0807 13:33:24.258266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.392165 (+133899us) service_pool.cc:227] Handling call
0807 13:33:25.731701 (+1339536us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540029efd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:25.731899 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":475951488}
I20260807 13:33:25.745421 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.746522 5659 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:25.709635 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.753937 5662 raft_consensus.cc:2354] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:25.753897 7841 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.758368 5542 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:25.492885 7817 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.757719 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.754429 5667 rpcz_store.cc:276] 0807 13:33:23.859904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.074922 (+215018us) service_pool.cc:227] Handling call
0807 13:33:25.710601 (+1635679us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54002d1254. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:25.710923 (+ 322us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1135120256}
I20260807 13:33:25.770819 8005 raft_consensus.cc:3032] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:25.757427 5658 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:25.776018 7947 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.226s user 0.010s sys 0.000s
W20260807 13:33:25.776499 7947 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s user 0.011s sys 0.000s
I20260807 13:33:25.776305 5725 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:25.777637 8012 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:25.779904 7980 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:25.729664 8017 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.780808 7980 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.777653 7947 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:25.813962 7949 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:25.791448 7991 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:25.811167 7892 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:25.845021 7947 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.813249 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.847591 7947 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:25.819934 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.796926 5556 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:25.849014 5552 raft_consensus.cc:2354] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:25.849509 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.847332 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.849921 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.773284 8113 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:25.774354 8005 raft_consensus.cc:729] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:25.811300 6636 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:25.767894 8082 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:25.853178 8082 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.848062 8017 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.809530 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.840307 8012 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:25.797435 7955 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.791576 7817 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:25.850090 5556 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:25.851524 5662 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:25.829507 5543 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:25.857303 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 972) took 1049 ms. Trace:
I20260807 13:33:25.830278 5554 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
W20260807 13:33:25.821573 8121 log.cc:924] Time spent T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260807 13:33:25.850682 5552 raft_consensus.cc:2362] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 3. Re-sending same reply.
I20260807 13:33:25.878633 5555 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:25.803951 7853 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.884434 7853 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.862829 7980 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:25.889292 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 954) took 1113 ms. Trace:
I20260807 13:33:25.875438 5660 rpcz_store.cc:276] 0807 13:33:24.808344 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.962052 (+153708us) service_pool.cc:227] Handling call
0807 13:33:25.857081 (+895029us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400101154. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:25.857239 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1437292416}
I20260807 13:33:25.853642 8005 consensus_queue.cc:260] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.891795 8080 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.892426 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 944) took 1134 ms. Trace:
I20260807 13:33:25.892517 8080 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.892396 8005 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:25.890033 5659 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:25.889678 5662 rpcz_store.cc:276] 0807 13:33:24.765001 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:25.850787 (+1085786us) service_pool.cc:227] Handling call
0807 13:33:25.851231 (+ 444us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:25.878244 (+ 27013us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.878430 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:25.879135 5548 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:25.799291 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:25.904774 5542 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:25.893021 5665 rpcz_store.cc:276] 0807 13:33:24.757782 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.757945 (+ 163us) service_pool.cc:227] Handling call
0807 13:33:24.758244 (+ 299us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:24.758426 (+ 182us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:33:24.777764 (+ 19338us) log.cc:842] Serialized 14 byte log entry
0807 13:33:25.859620 (+1081856us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b1800395a40. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff681ff75bb 00007ff681ffd063 00007ff681ffd57b 00007ff68238088a
0807 13:33:25.891753 (+ 32133us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:25.891863 (+ 110us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:25.891961 (+ 98us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.892043 (+ 82us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:25.892208 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20054,"prepare.queue_time_us":18379,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1241,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":208,"spinlock_wait_cycles":12007296,"thread_start_us":27555,"threads_started":1}
I20260807 13:33:25.906260 5661 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:25.913573 8033 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.914251 8033 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:25.916491 8033 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:25.892482 6687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57224 (request call id 155) took 1408 ms. Trace:
I20260807 13:33:25.917145 6687 rpcz_store.cc:276] 0807 13:33:24.483645 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.483797 (+ 152us) service_pool.cc:227] Handling call
0807 13:33:25.368534 (+884737us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:25.447344 (+ 78810us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.892044 (+444700us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54004fecd0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:25.892293 (+ 249us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2033958144}
I20260807 13:33:25.925377 5661 raft_consensus.cc:1226] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:25.926537 5762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47820 (request call id 90) took 1446 ms. Trace:
I20260807 13:33:25.926928 5762 rpcz_store.cc:276] 0807 13:33:24.479609 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.492069 (+ 12460us) service_pool.cc:227] Handling call
0807 13:33:24.492415 (+ 346us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:24.752694 (+260279us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:24.752738 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:24.752786 (+ 48us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:33:24.752813 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.926043 (+1173230us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54001f1654. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:25.926119 (+ 76us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:25.926353 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":520773376}
I20260807 13:33:25.927788 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.928078 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 958) took 1162 ms. Trace:
I20260807 13:33:25.930413 5661 rpcz_store.cc:276] 0807 13:33:24.765889 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:25.918613 (+1152724us) service_pool.cc:227] Handling call
0807 13:33:25.924828 (+ 6215us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:25.927026 (+ 2198us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.927699 (+ 673us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:25.930923 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 957) took 1165 ms. Trace:
I20260807 13:33:25.931584 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.932047 6685 raft_consensus.cc:2379] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:25.932309 5661 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:25.933436 7890 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:25.933607 8024 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:25.933734 5556 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:25.934365 7890 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:25.939610 5661 raft_consensus.cc:1226] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:25.939833 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.940279 7890 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:25.940582 5553 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:25.931350 5667 rpcz_store.cc:276] 0807 13:33:24.765681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:25.929839 (+1164158us) service_pool.cc:227] Handling call
0807 13:33:25.930286 (+ 447us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:25.930590 (+ 304us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:25.930640 (+ 50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:25.930705 (+ 65us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:25.930729 (+ 24us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.930780 (+ 51us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:25.930863 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:25.887197 7853 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:25.940327 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 961) took 1173 ms. Trace:
I20260807 13:33:25.938090 5662 raft_consensus.cc:1261] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:25.953593 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.051445 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.952617 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.040412 5665 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:25.943105 5667 raft_consensus.cc:1261] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 13:33:25.746865 6681 rpcz_store.cc:269] 0807 13:33:24.265829 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.268897 (+ 3068us) service_pool.cc:227] Handling call
0807 13:33:25.236381 (+967484us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5800005498. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416bce 000000000034aea9 00007ff687242a30 00007ff6873087b4 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:25.746062 (+509681us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":28404992}
I20260807 13:33:25.967321 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.972364 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.052757 5553 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:26.051278 5661 rpcz_store.cc:276] 0807 13:33:24.766558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:25.932938 (+1166380us) service_pool.cc:227] Handling call
0807 13:33:25.939394 (+ 6456us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:25.940093 (+ 699us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:25.940265 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.054963 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 964) took 1274 ms. Trace:
I20260807 13:33:26.054872 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 963) took 1273 ms. Trace:
I20260807 13:33:26.055409 5667 rpcz_store.cc:276] 0807 13:33:24.778871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:25.942291 (+1163420us) service_pool.cc:227] Handling call
0807 13:33:25.942705 (+ 414us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.053109 (+110404us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.053301 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.055526 5662 rpcz_store.cc:276] 0807 13:33:24.778492 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:25.937046 (+1158554us) service_pool.cc:227] Handling call
0807 13:33:25.937531 (+ 485us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.051701 (+114170us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.051898 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.056607 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 959) took 1290 ms. Trace:
I20260807 13:33:26.056895 5665 rpcz_store.cc:276] 0807 13:33:24.766094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.039670 (+1273576us) service_pool.cc:227] Handling call
0807 13:33:26.040165 (+ 495us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.056432 (+ 16267us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.056556 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:26.059496 5656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1310) took 1807 ms (client timeout 2155 ms). Trace:
W20260807 13:33:26.060091 5656 rpcz_store.cc:269] 0807 13:33:24.251706 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.253962 (+ 2256us) service_pool.cc:227] Handling call
0807 13:33:26.047242 (+1793280us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b540026cad4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:26.058236 (+ 10994us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":166350720}
W20260807 13:33:26.061421 5722 leader_election.cc:334] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.713s (SENT)
I20260807 13:33:26.062582 5548 raft_consensus.cc:2354] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:26.063040 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:25.968657 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:25.940896 8080 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.002812 7933 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:25.952793 8082 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:26.070590 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.068293 5656 raft_consensus.cc:1261] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:26.071751 5543 raft_consensus.cc:2362] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 4. Re-sending same reply.
I20260807 13:33:26.072242 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 979) took 1218 ms. Trace:
I20260807 13:33:26.072724 5656 rpcz_store.cc:276] 0807 13:33:24.854095 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.061342 (+1207247us) service_pool.cc:227] Handling call
0807 13:33:26.061769 (+ 427us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.071925 (+ 10156us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.072178 (+ 253us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.072947 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.074091 5543 raft_consensus.cc:2354] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
I20260807 13:33:26.070767 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.068370 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:33:26.074038 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.076490 5667 raft_consensus.cc:1261] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:26.076939 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 971) took 1285 ms. Trace:
I20260807 13:33:26.077155 5667 rpcz_store.cc:276] 0807 13:33:24.791913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.056213 (+1264300us) service_pool.cc:227] Handling call
0807 13:33:26.075372 (+ 19159us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.076789 (+ 1417us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.076904 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.077773 5662 raft_consensus.cc:1226] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:26.078505 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.079914 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.080824 5553 raft_consensus.cc:2396] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:26.075692 5552 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:26.064862 5663 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:26.075467 5542 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
W20260807 13:33:26.081892 5722 leader_election.cc:334] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.748s (SENT)
I20260807 13:33:26.085192 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.085793 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 973) took 1233 ms. Trace:
I20260807 13:33:26.087066 5662 rpcz_store.cc:276] 0807 13:33:24.852356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.056305 (+1203949us) service_pool.cc:227] Handling call
0807 13:33:26.075394 (+ 19089us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.083629 (+ 8235us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.085755 (+ 2126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":21248}
I20260807 13:33:26.091030 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.086598 5660 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:26.091794 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.079238 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:33:26.092566 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.070801 5658 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:26.093324 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.073011 5391 catalog_manager.cc:5495] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 3 to 4, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 4 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 13:33:26.065292 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 254358us
I20260807 13:33:26.097834 5659 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:26.099228 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:26.099277 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.096632 5548 raft_consensus.cc:2454] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:26.101112 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 968) took 1312 ms. Trace:
I20260807 13:33:26.101665 5555 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:26.102064 5660 raft_consensus.cc:2379] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:26.101462 5661 rpcz_store.cc:276] 0807 13:33:24.784254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.064797 (+1280543us) service_pool.cc:227] Handling call
0807 13:33:26.081988 (+ 17191us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.094723 (+ 12735us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:26.094767 (+ 44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:26.094834 (+ 67us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:26.094871 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.096489 (+ 1618us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:26.096557 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.103070 8020 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.103649 5554 raft_consensus.cc:1226] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:26.103586 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:26.104724 5658 raft_consensus.cc:2379] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:26.105003 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.105834 5554 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:26.107787 5544 raft_consensus.cc:2396] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:26.108145 7278 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:26.107112 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:26.101747 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 368004us
I20260807 13:33:26.112142 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.110301 5544 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:33:26.105983 5658 raft_consensus.cc:1226] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:26.115935 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 977) took 1262 ms. Trace:
W20260807 13:33:26.115383 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 44348.7us
I20260807 13:33:26.116467 5665 rpcz_store.cc:276] 0807 13:33:24.853522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.063756 (+1210234us) service_pool.cc:227] Handling call
0807 13:33:26.102029 (+ 38273us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.115547 (+ 13518us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:26.115578 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:26.115690 (+ 112us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:26.115725 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.115777 (+ 52us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:26.115882 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.117810 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:26.118633 5665 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:26.119937 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:26.120659 5665 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:26.120843 5544 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:26.121690 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.122527 5767 raft_consensus.cc:2379] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:26.122830 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.123503 5769 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:26.123481 5544 raft_consensus.cc:1261] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:26.124706 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:26.125237 5544 raft_consensus.cc:1226] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:26.126484 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.127149 5665 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:26.127885 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1317) took 1153 ms. Trace:
I20260807 13:33:26.128242 5665 rpcz_store.cc:276] 0807 13:33:24.974024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.126406 (+1152382us) service_pool.cc:227] Handling call
0807 13:33:26.126783 (+ 377us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:26.127614 (+ 831us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.127804 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.128654 5555 raft_consensus.cc:1226] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
W20260807 13:33:26.129279 5722 leader_election.cc:334] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.766s (SENT)
I20260807 13:33:26.129741 5722 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:26.130766 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 80) took 1105 ms. Trace:
I20260807 13:33:26.131484 5555 raft_consensus.cc:1226] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:26.131692 5665 rpcz_store.cc:276] 0807 13:33:25.025413 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.129742 (+1104329us) service_pool.cc:227] Handling call
0807 13:33:26.130192 (+ 450us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.130437 (+ 245us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:26.130459 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:26.130497 (+ 38us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:26.130529 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.130598 (+ 69us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:26.130704 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.125880 5667 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:26.133198 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 981) took 1278 ms. Trace:
I20260807 13:33:26.133587 5667 rpcz_store.cc:276] 0807 13:33:24.854739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.084345 (+1229606us) service_pool.cc:227] Handling call
0807 13:33:26.113709 (+ 29364us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.132987 (+ 19278us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.133150 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.134145 8019 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:26.134227 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:26.134594 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:26.134905 5665 raft_consensus.cc:2362] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 5. Re-sending same reply.
I20260807 13:33:26.135454 5667 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:26.136745 5667 raft_consensus.cc:1226] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:26.136873 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1326) took 1104 ms. Trace:
I20260807 13:33:26.134554 5721 leader_election.cc:398] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:26.138511 5721 leader_election.cc:401] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:26.137655 5665 rpcz_store.cc:276] 0807 13:33:25.032851 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.135556 (+1102705us) service_pool.cc:227] Handling call
0807 13:33:26.135872 (+ 316us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.136511 (+ 639us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:26.136540 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:26.136617 (+ 77us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:26.136670 (+ 53us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.136726 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:26.136832 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":127}
I20260807 13:33:26.139708 5721 leader_election.cc:398] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
I20260807 13:33:26.139711 5665 raft_consensus.cc:1261] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:26.140130 5721 leader_election.cc:401] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260807 13:33:26.140892 7959 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:26.141517 7959 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:26.142388 5543 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260807 13:33:26.142729 5543 pending_rounds.cc:76] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 2
I20260807 13:33:26.142951 5543 pending_rounds.cc:97] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260807 13:33:26.143307 5543 raft_consensus.cc:2866] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:26.140031 5662 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:26.144007 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 933) took 1040 ms. Trace:
I20260807 13:33:26.144995 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.146009 5665 raft_consensus.cc:1261] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:26.146158 7812 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
I20260807 13:33:26.146301 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 79) took 1179 ms. Trace:
I20260807 13:33:26.146759 5660 rpcz_store.cc:276] 0807 13:33:24.967315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.110817 (+1143502us) service_pool.cc:227] Handling call
0807 13:33:26.144062 (+ 33245us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.145921 (+ 1859us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:26.145943 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:26.145986 (+ 43us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:33:26.146043 (+ 57us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.146120 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:26.146220 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.144287 5548 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 13:33:26.150615 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 937) took 1046 ms. Trace:
I20260807 13:33:26.150832 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.151273 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 955) took 1386 ms. Trace:
I20260807 13:33:26.151506 5769 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:26.151777 5659 rpcz_store.cc:276] 0807 13:33:24.765217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:25.952559 (+1187342us) service_pool.cc:227] Handling call
0807 13:33:26.097664 (+145105us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.106250 (+ 8586us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.151076 (+ 44826us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000e47d0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:26.151197 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":252607360}
I20260807 13:33:26.153007 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.154047 5762 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:26.155586 5554 raft_consensus.cc:1226] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:26.158138 5554 raft_consensus.cc:1261] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:26.151011 5548 rpcz_store.cc:276] 0807 13:33:25.104475 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.102187 (+997712us) service_pool.cc:227] Handling call
0807 13:33:26.112242 (+ 10055us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.150394 (+ 38152us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.150569 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1088128}
I20260807 13:33:26.161290 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.161914 5769 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:33:26.162490 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.170374 7812 consensus_queue.cc:1046] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 13:33:26.172055 5767 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:26.172840 5765 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:26.127151 5544 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:26.162034 5391 catalog_manager.cc:5495] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 3 to 4, VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) evicted, no longer has a pending config: VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193), VOTER 737c581af06a42df94970a1542600159 (127.3.187.195), VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 4 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:33:26.163604 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.163874 5660 raft_consensus.cc:1261] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:26.137867 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 985) took 1029 ms. Trace:
I20260807 13:33:26.164036 5389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51216 (request call id 193) took 9927 ms. Trace:
I20260807 13:33:26.164680 5556 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:26.165298 7958 consensus_queue.cc:1046] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:26.168088 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.102136 7933 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.169219 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:26.169727 5620 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.169972 5721 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.144738 5543 rpcz_store.cc:276] 0807 13:33:25.103345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.110469 (+1007124us) service_pool.cc:227] Handling call
0807 13:33:26.142049 (+ 31580us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.143775 (+ 1726us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.143946 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.173969 5553 raft_consensus.cc:1226] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:26.177740 5667 rpcz_store.cc:276] 0807 13:33:25.107988 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.136165 (+1028177us) service_pool.cc:227] Handling call
0807 13:33:26.136511 (+ 346us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.137662 (+ 1151us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.137821 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.173552 7812 raft_consensus.cc:3032] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:26.182731 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:26.183758 7958 raft_consensus.cc:3032] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:26.172786 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 980) took 1318 ms. Trace:
W20260807 13:33:26.191535 5722 leader_election.cc:334] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.837s (SENT)
I20260807 13:33:26.194195 5548 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:33:26.187769 7958 raft_consensus.cc:729] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:26.195262 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.195829 5548 raft_consensus.cc:2362] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 3. Re-sending same reply.
I20260807 13:33:26.195886 8070 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.196323 8070 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.196678 8070 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.196487 8012 consensus_queue.cc:1046] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:26.183650 5391 catalog_manager.cc:5495] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 2 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:33:26.197882 5391 catalog_manager.cc:5495] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: config changed from index 3 to 5, VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) evicted. New cstate: current_term: 2 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:26.198472 7669 consensus_queue.cc:1046] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:26.184458 7812 raft_consensus.cc:729] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:26.198534 7873 consensus_queue.cc:1035] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:26.199543 7669 raft_consensus.cc:3032] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:26.200049 7669 raft_consensus.cc:729] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:26.200372 7812 consensus_queue.cc:260] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.200950 7669 consensus_queue.cc:260] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.195427 7958 consensus_queue.cc:260] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:26.190177 7933 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:26.198730 7817 raft_consensus.cc:3032] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:26.202739 7817 raft_consensus.cc:729] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:26.203015 7958 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.201869 7812 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.204032 7817 consensus_queue.cc:260] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.196831 5666 raft_consensus.cc:2396] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:26.207221 5542 raft_consensus.cc:1226] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:26.207540 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 965) took 1428 ms. Trace:
I20260807 13:33:26.207805 5662 raft_consensus.cc:1261] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:33:26.208132 5662 pending_rounds.cc:76] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting all ops after (but not including) 1
I20260807 13:33:26.208488 5662 pending_rounds.cc:97] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:33:26.198530 8012 consensus_queue.cc:1035] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260807 13:33:26.208765 5662 raft_consensus.cc:2866] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:26.208854 5542 raft_consensus.cc:1226] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
W20260807 13:33:26.210225 8125 log.cc:924] Time spent T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.117s user 0.000s sys 0.000s
I20260807 13:33:26.210520 5663 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:26.210842 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:26.211256 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1316) took 1237 ms. Trace:
I20260807 13:33:26.188203 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 930) took 1082 ms. Trace:
I20260807 13:33:26.211956 5548 raft_consensus.cc:1261] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:26.212095 5553 rpcz_store.cc:276] 0807 13:33:25.102477 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.110572 (+1008095us) service_pool.cc:227] Handling call
0807 13:33:26.173746 (+ 63174us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.184573 (+ 10827us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.184784 (+ 211us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.212689 8114 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:26.212486 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:26.220463 8114 raft_consensus.cc:686] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:26.221622 8114 consensus_queue.cc:237] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.222959 6687 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:26.211614 5663 rpcz_store.cc:276] 0807 13:33:24.973750 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.111831 (+1138081us) service_pool.cc:227] Handling call
0807 13:33:26.210308 (+ 98477us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.211016 (+ 708us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.211206 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.214346 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:26.215301 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:26.215147 7856 consensus_queue.cc:1046] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:26.207965 5666 rpcz_store.cc:276] 0807 13:33:24.779188 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:24.779396 (+ 208us) service_pool.cc:227] Handling call
0807 13:33:25.709208 (+929812us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:26.207319 (+498111us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540026d9d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:26.207489 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":894397568}
I20260807 13:33:26.214972 5499 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:26.186573 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 984) took 1226 ms. Trace:
I20260807 13:33:26.177057 5389 rpcz_store.cc:276] 0807 13:33:16.236669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:16.236890 (+ 221us) service_pool.cc:227] Handling call
0807 13:33:26.163800 (+9926910us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:22.060067 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:22.120517 (+ 60450us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:22.120552 (+ 35us) write_op.cc:435] Acquired schema lock
0807 13:33:22.120580 (+ 28us) tablet.cc:660] Decoding operations
0807 13:33:22.121180 (+ 600us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:22.121252 (+ 72us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:22.121280 (+ 28us) tablet.cc:683] Acquiring locks for 4 operations
0807 13:33:22.121667 (+ 387us) tablet.cc:699] Row locks acquired
0807 13:33:22.121679 (+ 12us) write_op.cc:260] PREPARE: finished
0807 13:33:22.121845 (+ 166us) write_op.cc:270] Start()
0807 13:33:22.121944 (+ 99us) write_op.cc:276] Timestamp: P: 1786109602121785 usec, L: 0
0807 13:33:22.121963 (+ 19us) op_driver.cc:331] REPLICATION: starting
0807 13:33:22.122619 (+ 656us) log.cc:842] Serialized 1705 byte log entry
0807 13:33:23.272560 (+1149941us) op_driver.cc:444] REPLICATION: finished
0807 13:33:23.557815 (+285255us) write_op.cc:301] APPLY: starting
0807 13:33:23.566422 (+ 8607us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:23.580720 (+ 14298us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:23.589166 (+ 8446us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:23.630698 (+ 41532us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:23.630889 (+ 191us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0807 13:33:23.630936 (+ 47us) write_op.cc:312] APPLY: finished
0807 13:33:23.631170 (+ 234us) log.cc:842] Serialized 40 byte log entry
0807 13:33:23.631340 (+ 170us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:23.696266 (+ 64926us) write_op.cc:454] Released schema lock
0807 13:33:23.700684 (+ 4418us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:23.774033 (+ 73349us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:23.780211 (+ 6178us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":683028,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":257360,"apply.run_cpu_time_us":2983,"apply.run_wall_time_us":243975,"num_ops":4,"prepare.queue_time_us":1367188,"prepare.run_cpu_time_us":59016,"prepare.run_wall_time_us":272178,"raft.queue_time_us":581813,"raft.run_cpu_time_us":17259,"raft.run_wall_time_us":268306,"replication_time_us":1145301,"thread_start_us":1628025,"threads_started":4,"wal-append.queue_time_us":260733,"wal-append.run_cpu_time_us":39363,"wal-append.run_wall_time_us":2252044}]]}
I20260807 13:33:26.190622 5656 rpcz_store.cc:276] 0807 13:33:24.854428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.074944 (+1220516us) service_pool.cc:227] Handling call
0807 13:33:26.106473 (+ 31529us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.170377 (+ 63904us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:26.170406 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:26.170465 (+ 59us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:26.170503 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.170574 (+ 71us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:26.172728 (+ 2154us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.231920 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.233070 5548 raft_consensus.cc:1226] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:26.223560 7817 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:26.218488 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.218465 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.189185 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:26.237278 5553 raft_consensus.cc:1261] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:26.235719 5544 raft_consensus.cc:2362] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 5. Re-sending same reply.
I20260807 13:33:26.241990 5554 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:26.243268 5548 raft_consensus.cc:1261] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:26.228916 8012 consensus_queue.cc:1046] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260807 13:33:26.250728 5620 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.253373 5553 raft_consensus.cc:1261] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:26.228555 5658 rpcz_store.cc:276] 0807 13:33:24.958614 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.105373 (+1146759us) service_pool.cc:227] Handling call
0807 13:33:26.105789 (+ 416us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:26.171206 (+ 65417us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:26.185246 (+ 14040us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:26.261832 5620 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.264882 5499 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:26.264871 5620 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.263302 5721 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:26.255579 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:26.267885 7890 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.268797 8020 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.260071 7933 consensus_queue.cc:1035] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260807 13:33:26.290773 8122 raft_consensus.cc:2741] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260807 13:33:26.275233 7669 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:26.277070 6687 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:26.268191 7959 consensus_queue.cc:1035] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260807 13:33:26.289278 5620 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.276803 8080 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.288609 7890 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:26.303755 7890 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.304936 5503 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:26.305961 8020 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.307101 7853 raft_consensus.cc:3032] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:26.307493 7853 raft_consensus.cc:729] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:26.308308 7853 consensus_queue.cc:260] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.308748 8020 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.309518 7853 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:26.286840 7873 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.286548 8029 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:26.277387 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:26.290170 7955 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.323540 7955 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:26.324101 7955 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:26.329814 5722 leader_election.cc:334] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.994s (SENT)
I20260807 13:33:26.330449 5722 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:26.336154 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 69247.7us
I20260807 13:33:26.342890 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:26.343724 5556 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 3.
I20260807 13:33:26.343856 5552 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:26.345220 8073 raft_consensus.cc:3032] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:26.345604 8073 raft_consensus.cc:729] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:26.346654 5543 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:26.311224 8080 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:26.356930 5499 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:26.354949 8005 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.358385 8005 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:26.361017 7890 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:26.361811 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.363772 7890 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:26.365240 5767 raft_consensus.cc:1226] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:26.366971 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:26.367122 8005 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.280616 8012 consensus_queue.cc:1046] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260807 13:33:26.368889 8012 raft_consensus.cc:3032] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:26.369328 8012 raft_consensus.cc:729] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:26.369591 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:26.370378 8012 consensus_queue.cc:260] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.372052 8012 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.374818 7669 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 13:33:26.376654 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 46885us
W20260807 13:33:26.377545 5722 leader_election.cc:334] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.000s (SENT)
I20260807 13:33:26.378911 5722 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:26.379935 7959 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:33:26.387209 5618 leader_election.cc:334] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.545s (SENT)
I20260807 13:33:26.314738 7873 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:26.334888 7856 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.350957 6687 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:26.422875 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.387971 8080 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.393788 8005 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.428005 5771 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260807 13:33:26.428649 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 77377.7us
I20260807 13:33:26.429261 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.433276 8082 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.433916 8082 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.391811 8073 consensus_queue.cc:260] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.347633 7955 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.400964 7873 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.418828 7856 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:26.434990 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 130293us
I20260807 13:33:26.447119 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 853) took 1338 ms. Trace:
I20260807 13:33:26.440407 5765 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:26.434593 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:26.446897 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 90076.4us
W20260807 13:33:26.440701 8129 log.cc:924] Time spent T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.094s user 0.003s sys 0.000s
I20260807 13:33:26.461688 5554 rpcz_store.cc:276] 0807 13:33:25.108735 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.250943 (+1142208us) service_pool.cc:227] Handling call
0807 13:33:26.446496 (+195553us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b54003976d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:26.447031 (+ 535us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":81582976}
I20260807 13:33:26.452330 7856 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.435966 8073 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:26.443090 8029 raft_consensus.cc:686] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:26.440970 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.447255 7944 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:26.435127 7980 raft_consensus.cc:2741] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:33:26.436482 8082 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.521157 5620 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.437649 7955 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.441114 7949 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.497054 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.505035 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.506887 5721 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.507488 7817 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:26.508392 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.528834 5620 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:26.442978 8016 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
I20260807 13:33:26.470155 8005 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:26.527921 5770 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:26.530279 5721 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.533597 5765 raft_consensus.cc:1226] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:26.434082 8070 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.536602 5766 raft_consensus.cc:2396] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:26.536758 5763 raft_consensus.cc:1261] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:33:26.537716 7883 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:26.538208 7883 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.538650 7883 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.538482 8122 consensus_queue.cc:1035] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:26.541860 8122 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.530167 5761 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:26.542359 8122 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.543221 7949 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } attrs { replace: true } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:26.545686 5620 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.546180 8020 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:33:26.547645 8019 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.548008 8019 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.548388 8019 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.546674 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.550024 8029 consensus_queue.cc:237] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.550958 5761 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:26.554708 5620 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.555428 8122 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.555968 8122 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:26.556344 8122 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.559958 8122 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.529922 7278 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.560873 7278 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.532333 7853 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:26.534319 8082 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:26.559203 8019 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.570079 7933 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:26.527238 7944 raft_consensus.cc:686] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:26.574823 5769 raft_consensus.cc:1226] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:26.570510 7933 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:33:26.591200 8141 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20260807 13:33:26.599810 7817 consensus_queue.cc:1035] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:26.602190 5499 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:26.603245 5771 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:26.564762 7873 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:26.584332 7853 raft_consensus.cc:686] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:26.586408 7933 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.615196 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:26.632920 5767 raft_consensus.cc:2396] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 13:33:26.631803 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 60805.1us
I20260807 13:33:26.638862 5665 raft_consensus.cc:2379] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:26.579579 8080 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.645654 7949 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:26.647468 7873 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:26.650810 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:26.651629 6681 raft_consensus.cc:2379] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:26.653510 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:26.656286 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.657065 5769 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.662599 7853 consensus_queue.cc:237] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.664052 7944 consensus_queue.cc:237] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.636756 7958 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:26.678843 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.642769 8019 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.667789 7278 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.686641 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:26.718762 5499 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:26.697924 7958 raft_consensus.cc:686] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:26.713373 7947 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:26.726482 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.718827 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:26.734898 5767 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:26.735373 5663 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:26.736235 6638 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:26.771873 7958 consensus_queue.cc:237] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.777935 7884 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:26.778365 7884 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.778699 7884 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.728166 8005 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.784499 7669 consensus_queue.cc:1046] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:26.739254 8070 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:26.785621 7812 raft_consensus.cc:3032] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:26.785912 7949 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:26.786020 7812 raft_consensus.cc:729] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:26.786494 7949 raft_consensus.cc:686] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:26.786916 7812 consensus_queue.cc:260] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.787380 7949 consensus_queue.cc:237] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.788136 7812 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:26.436012 7890 consensus_queue.cc:1159] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "737c581af06a42df94970a1542600159" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 13:33:26.738703 8082 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.790714 8082 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.792995 8082 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.738984 7873 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.793788 7873 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:26.795766 7873 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:26.715548 8122 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.852496 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:26.857838 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 121702us
I20260807 13:33:26.857872 5763 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:26.849880 7669 consensus_queue.cc:1046] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260807 13:33:26.863129 5499 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:26.859731 5620 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.868889 5666 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:26.876791 8012 raft_consensus.cc:3032] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:26.877202 8012 raft_consensus.cc:729] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:26.878010 8012 consensus_queue.cc:260] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.878996 8070 consensus_queue.cc:1046] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:26.880255 7669 raft_consensus.cc:3032] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:26.880601 7669 raft_consensus.cc:729] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:26.881379 7669 consensus_queue.cc:260] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.855597 7873 consensus_queue.cc:1035] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260807 13:33:26.882520 7669 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:26.860647 7959 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.883580 7959 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.885506 7959 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:26.890618 5499 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:26.891898 5499 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:26.889894 5769 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:26.892074 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.892580 8029 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.892959 8029 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:26.893172 5499 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:26.893435 8029 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.879334 8012 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.902992 5499 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:26.907805 5620 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:26.910483 5722 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:26.865911 8080 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.912410 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.913455 5767 raft_consensus.cc:1261] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:26.913985 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.914752 5770 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.914896 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.892093 7949 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:26.920974 5765 raft_consensus.cc:2396] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260807 13:33:26.921952 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 167058us
I20260807 13:33:26.924162 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:26.924880 6685 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:26.925890 5725 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:26.926626 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.931242 8122 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.904839 7955 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
W20260807 13:33:26.938988 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 65970.5us
I20260807 13:33:26.874426 8016 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:33:26.942523 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 48418.4us
I20260807 13:33:26.946552 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:26.942905 7949 raft_consensus.cc:686] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:26.951508 7991 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:26.951128 8179 consensus_queue.cc:1046] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 13:33:26.951782 7949 consensus_queue.cc:237] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.952028 7991 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.952531 8179 raft_consensus.cc:3032] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:26.953028 8179 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:26.954288 7812 raft_consensus.cc:2726] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:26.954540 8070 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.954977 8070 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.955247 8020 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:26.955310 8070 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.956050 7883 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.957373 5618 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:26.912288 7884 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:26.945643 7944 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.958549 7944 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.958662 5618 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:26.958915 7944 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.959609 7884 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.960021 5618 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:26.960242 7278 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 13:33:26.960685 7278 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:26.961042 7278 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:26.943539 8016 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.962745 8016 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.962695 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:26.904985 7947 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:26.963563 7947 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.963986 7947 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.954305 8179 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:26.965590 8179 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:26.963511 5658 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.964756 5391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36640 (request call id 66) took 10082 ms. Trace:
I20260807 13:33:26.971592 5531 tablet_service.cc:1514] Processing DeleteTablet for tablet 93d548887d4245c7b22072e49517a84f with delete_type TABLET_DATA_TOMBSTONED (TS 14f62bf285c448b9b7a21fabd7a5f0bf not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54374
I20260807 13:33:26.975538 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.976238 5771 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.953894 7991 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:26.978127 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.979418 5761 raft_consensus.cc:3037] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.979830 8082 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:26.971580 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:26.985117 5767 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.972443 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:26.980300 8082 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:26.989333 7980 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:26.989507 8082 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.989797 7980 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:26.990274 7980 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:26.966913 5394 catalog_manager.cc:5495] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 3 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 4 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:26.994807 8020 raft_consensus.cc:686] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:26.994642 5394 catalog_manager.cc:5495] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: config changed from index 2 to 3, d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193), VOTER 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194), VOTER 737c581af06a42df94970a1542600159 (127.3.187.195), VOTER d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 3 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:33:26.995841 8020 consensus_queue.cc:237] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.998472 8029 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.998689 7933 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:26.999794 5762 raft_consensus.cc:2354] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:27.005788 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.006613 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.007041 5769 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:27.003022 5620 leader_election.cc:398] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:27.008101 5620 leader_election.cc:401] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260807 13:33:27.006172 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:27.000473 8029 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.014555 5771 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:27.014717 5770 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:27.016049 5764 raft_consensus.cc:2379] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:27.016124 5394 catalog_manager.cc:5495] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 2 to 3, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 3 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:27.028950 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.031175 5620 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:27.029464 5762 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
W20260807 13:33:27.004232 8073 consensus_meta.cc:287] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.501s user 0.009s sys 0.000s
I20260807 13:33:26.958105 7883 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:26.973395 5391 rpcz_store.cc:276] 0807 13:33:16.882312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:16.882601 (+ 289us) service_pool.cc:227] Handling call
0807 13:33:26.964697 (+10082096us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:26.322855 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:26.323713 (+ 858us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:26.323781 (+ 68us) write_op.cc:435] Acquired schema lock
0807 13:33:26.323808 (+ 27us) tablet.cc:660] Decoding operations
0807 13:33:26.324661 (+ 853us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:26.324785 (+ 124us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:26.324840 (+ 55us) tablet.cc:683] Acquiring locks for 4 operations
0807 13:33:26.325486 (+ 646us) tablet.cc:699] Row locks acquired
0807 13:33:26.325530 (+ 44us) write_op.cc:260] PREPARE: finished
0807 13:33:26.325755 (+ 225us) write_op.cc:270] Start()
0807 13:33:26.325927 (+ 172us) write_op.cc:276] Timestamp: P: 1786109606325680 usec, L: 0
0807 13:33:26.325979 (+ 52us) op_driver.cc:331] REPLICATION: starting
0807 13:33:26.326962 (+ 983us) log.cc:842] Serialized 1685 byte log entry
0807 13:33:26.721466 (+394504us) op_driver.cc:444] REPLICATION: finished
0807 13:33:26.858317 (+136851us) write_op.cc:301] APPLY: starting
0807 13:33:26.865825 (+ 7508us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:26.892813 (+ 26988us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:26.892954 (+ 141us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:26.893626 (+ 672us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:26.893894 (+ 268us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0807 13:33:26.893957 (+ 63us) write_op.cc:312] APPLY: finished
0807 13:33:26.954575 (+ 60618us) log.cc:842] Serialized 40 byte log entry
0807 13:33:26.954773 (+ 198us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:26.954867 (+ 94us) write_op.cc:454] Released schema lock
0807 13:33:26.954924 (+ 57us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:26.955204 (+ 280us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:26.955235 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1261134,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":86760,"apply.run_cpu_time_us":3228,"apply.run_wall_time_us":105259,"num_ops":4,"prepare.queue_time_us":106055,"prepare.run_cpu_time_us":77925,"prepare.run_wall_time_us":168598,"raft.queue_time_us":164743,"raft.run_cpu_time_us":13021,"raft.run_wall_time_us":54603,"replication_time_us":395368,"thread_start_us":393094,"threads_started":4,"wal-append.queue_time_us":197166}]]}
I20260807 13:33:27.040560 5499 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:33:27.041174 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 81234.9us
I20260807 13:33:27.002301 8082 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.000528 7933 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:27.016018 8019 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:27.017256 8114 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:27.055342 8082 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.056547 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.056959 5618 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:27.057157 5763 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:27.005193 8070 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:27.046450 8122 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:27.032893 5658 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:27.065503 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:27.033063 8016 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.032055 8029 consensus_queue.cc:1046] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 13:33:27.080340 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.094636 5762 raft_consensus.cc:2379] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:27.063521 8082 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 13:33:27.099524 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 47945.6us
I20260807 13:33:27.060134 8012 consensus_queue.cc:1035] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260807 13:33:27.079011 8122 raft_consensus.cc:686] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:27.102891 5499 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:27.104377 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.105110 7949 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:27.105666 8187 tablet_replica.cc:330] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: stopping tablet replica
I20260807 13:33:27.095383 7955 raft_consensus.cc:686] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:27.109970 7949 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:27.124883 7949 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.125908 8082 raft_consensus.cc:686] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:27.118079 7944 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.126876 8082 consensus_queue.cc:237] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.128074 7944 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.128590 7944 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:27.129087 7944 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.122023 8019 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
W20260807 13:33:27.123315 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 75880.7us
I20260807 13:33:27.130149 7853 consensus_queue.cc:1046] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 13:33:27.103574 7856 consensus_meta.cc:287] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.585s user 0.004s sys 0.009s
I20260807 13:33:27.130229 5722 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:27.147907 5665 raft_consensus.cc:1261] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:27.149854 8201 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:27.150576 8201 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:27.151978 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.152441 8029 consensus_queue.cc:1225] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 0b9aca0aafaa43e7998ee8f3e59627e0 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:33:27.153900 5765 raft_consensus.cc:1226] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:27.154191 7873 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:27.154237 8029 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.154054 5722 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:27.103108 6636 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:27.154651 7873 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:27.163751 8187 raft_consensus.cc:2229] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 13:33:27.160061 8191 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260807 13:33:27.129112 5761 raft_consensus.cc:2454] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:27.107126 8193 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260807 13:33:27.159818 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.171495 7944 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.172770 7991 consensus_queue.cc:1035] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:27.144713 7853 raft_consensus.cc:3032] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:27.160487 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:27.178866 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 84655.2us
I20260807 13:33:27.184299 8073 consensus_queue.cc:1046] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:27.176594 7873 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:27.176234 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.178206 8201 raft_consensus.cc:3032] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:27.193241 8206 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.194053 8206 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.194825 8070 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:27.179776 7884 raft_consensus.cc:2781] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:27.196173 8206 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.195915 7955 consensus_queue.cc:237] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.196455 8016 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.196638 8206 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.185496 7933 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:27.197116 8206 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.195928 7884 raft_consensus.cc:686] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
W20260807 13:33:27.198395 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 44437.4us
I20260807 13:33:27.198611 7884 consensus_queue.cc:237] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:27.193322 7944 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.194945 8122 consensus_queue.cc:237] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.143883 7856 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.199625 5722 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:27.214735 5499 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:27.161602 8029 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.216713 8016 raft_consensus.cc:3032] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:27.185269 7853 raft_consensus.cc:729] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:27.223470 5656 raft_consensus.cc:1226] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:27.224067 7853 consensus_queue.cc:260] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.218315 8016 raft_consensus.cc:729] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:27.215858 7817 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:27.222137 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.222456 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:27.223057 5618 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:27.226197 5666 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:27.224934 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:27.200459 8201 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:27.233212 7853 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:27.235567 7856 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.233266 8029 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.235805 7278 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.237706 8206 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.222167 8187 raft_consensus.cc:2258] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 13:33:27.238404 7817 raft_consensus.cc:686] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:27.233385 7947 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.212075 7944 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.237532 8016 consensus_queue.cc:260] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.239023 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.233577 6687 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.248165 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.246078 5658 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:27.241997 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:27.256125 5660 raft_consensus.cc:1226] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:27.225708 7958 consensus_queue.cc:1035] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260807 13:33:27.257941 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.258212 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:27.258504 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.242527 8020 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:27.243963 7856 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260807 13:33:27.243468 8016 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:27.239342 7817 consensus_queue.cc:237] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:27.259797 8020 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:27.257494 7980 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:27.297227 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.301954 5767 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:27.259819 8186 raft_consensus.cc:3032] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:27.304178 5620 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:27.240303 7947 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.241020 7944 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.243003 7278 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.287953 8020 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:27.300192 7856 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.312603 5762 raft_consensus.cc:1261] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:27.242686 8073 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260807 13:33:27.319802 8202 consensus_queue.cc:1046] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:27.320058 5501 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:27.320549 5646 tablet_service.cc:1514] Processing DeleteTablet for tablet c61e1dd5b00c43d2a1747f4832ac333c with delete_type TABLET_DATA_TOMBSTONED (TS 0b9aca0aafaa43e7998ee8f3e59627e0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52568
I20260807 13:33:27.303222 8186 raft_consensus.cc:729] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:27.309630 7883 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:27.325416 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.328449 5501 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:27.314129 8206 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.326583 5499 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:27.336834 8193 raft_consensus.cc:3032] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:27.337306 8193 raft_consensus.cc:729] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:27.338303 8193 consensus_queue.cc:260] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.339779 8193 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.324442 8029 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:27.326260 7856 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.329210 8202 consensus_queue.cc:1046] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 13:33:27.349849 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.330854 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.352388 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.325060 7278 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260807 13:33:27.334777 7883 raft_consensus.cc:686] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:27.391348 5666 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:27.346889 7947 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:27.345392 5658 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:27.348980 7944 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:27.335037 7873 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:27.401322 5501 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:27.346987 8206 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.392988 8029 raft_consensus.cc:3032] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:27.424388 5656 raft_consensus.cc:2354] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:27.321678 8201 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.392458 7959 consensus_queue.cc:1035] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260807 13:33:27.453267 8201 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.453441 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.416263 8208 raft_consensus.cc:2684] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Received pre-election callback for term 4 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260807 13:33:27.454322 5656 raft_consensus.cc:2379] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:27.455174 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.419574 7947 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:27.430694 8209 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.449246 7883 consensus_queue.cc:237] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.451813 8206 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.452152 7933 consensus_queue.cc:1035] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:27.434484 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.430083 8029 raft_consensus.cc:729] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:33:27.468720 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 77274.9us
I20260807 13:33:27.430524 7955 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
W20260807 13:33:27.439286 8212 log.cc:924] Time spent T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.085s user 0.000s sys 0.000s
I20260807 13:33:27.445907 7856 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.443198 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.481698 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.449270 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:27.476614 7947 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.448644 7873 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:27.448230 7980 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:27.445005 6687 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:27.493427 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.503767 5659 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:27.504973 5663 raft_consensus.cc:1226] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:27.432919 7949 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.394627 8186 consensus_queue.cc:260] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.506742 7955 raft_consensus.cc:686] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:27.532157 5725 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:27.507486 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:27.512799 7669 consensus_queue.cc:1035] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 13:33:27.536434 5501 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:27.542466 8222 log.cc:924] Time spent T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.127s user 0.001s sys 0.000s
I20260807 13:33:27.492993 8215 consensus_queue.cc:1035] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260807 13:33:27.492835 8209 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.543816 5503 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:27.551276 5762 raft_consensus.cc:1226] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:27.556299 5721 leader_election.cc:398] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:27.556565 5721 leader_election.cc:401] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260807 13:33:27.559346 8005 consensus_queue.cc:1046] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:33:27.560443 8005 raft_consensus.cc:3032] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:27.560849 8005 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:27.560887 8020 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.562191 5667 raft_consensus.cc:1226] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:27.562348 7933 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:27.540261 7959 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:27.558537 5721 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:27.533706 8206 consensus_queue.cc:1046] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260807 13:33:27.580084 7933 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:27.581982 7856 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.587152 7856 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.589304 7856 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.530884 8029 consensus_queue.cc:260] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.591526 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.568518 8114 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.595314 5665 raft_consensus.cc:1261] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:27.599254 5665 raft_consensus.cc:1261] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:27.596293 5763 raft_consensus.cc:2396] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:27.578338 8213 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:27.604740 7959 raft_consensus.cc:686] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:27.566293 8187 ts_tablet_manager.cc:1905] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 13:33:27.611297 8192 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.611426 8029 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:27.611886 8192 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.613868 8192 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.614328 7980 consensus_queue.cc:1035] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:27.615026 7949 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.616295 8020 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.561858 8005 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:27.606168 8114 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.620887 7955 consensus_queue.cc:237] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.622656 8114 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.614327 5369 catalog_manager.cc:4841] TS 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569): tablet c61e1dd5b00c43d2a1747f4832ac333c (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:33:27.624027 8209 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.627403 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.627561 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:27.628036 5762 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:27.592666 7933 raft_consensus.cc:686] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:27.628788 8192 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:27.629258 8192 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.629508 7933 consensus_queue.cc:237] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.631289 8192 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.632057 8209 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:27.632524 8209 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.580332 8235 raft_consensus.cc:2726] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:27.565101 7991 consensus_queue.cc:1046] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260807 13:33:27.634197 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.656049 5659 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:27.657151 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.657824 5659 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.636502 5665 raft_consensus.cc:1261] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260807 13:33:27.620424 8005 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:27.667012 5620 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:27.667429 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.671271 5659 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:27.643836 8193 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:27.675349 8016 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:27.675838 8016 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:27.675714 7949 consensus_queue.cc:1035] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:27.676294 8016 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:27.677001 7959 consensus_queue.cc:237] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:27.678443 5762 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 13:33:27.679088 7933 raft_consensus.cc:3032] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:27.679488 7933 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:27.680301 7933 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.681468 7933 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:27.675184 5501 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:27.683754 7980 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:27.683596 8016 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.684243 7980 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.688086 5501 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
W20260807 13:33:27.691870 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 112808us
I20260807 13:33:27.673583 8114 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:27.685434 8235 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:27.687463 7949 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:27.663100 8192 consensus_queue.cc:1046] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260807 13:33:27.704562 5501 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:27.691073 7884 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260807 13:33:27.709769 8114 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:27.739259 8114 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:27.701689 8213 raft_consensus.cc:2741] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 13:33:27.741052 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:27.741878 6681 raft_consensus.cc:2354] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4.
I20260807 13:33:27.743681 8016 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.711728 8235 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:27.689263 8193 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:27.766988 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 100061us
W20260807 13:33:27.768405 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 63935.5us
I20260807 13:33:27.770947 5501 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:27.774081 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 51256.3us
I20260807 13:33:27.766237 7949 raft_consensus.cc:3032] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:27.746251 8215 consensus_queue.cc:1035] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260807 13:33:27.778996 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.779645 5499 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:27.779659 5667 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:27.771735 8236 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:27.782888 5661 raft_consensus.cc:1261] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:27.771418 7873 consensus_queue.cc:1046] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260807 13:33:27.784178 5621 leader_election.cc:398] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077) with higher term. Message: Invalid argument: T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4.
I20260807 13:33:27.785873 5621 leader_election.cc:401] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:27.775208 8029 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:27.787842 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.789076 5767 raft_consensus.cc:1261] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:27.776957 7949 raft_consensus.cc:729] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:27.790968 5499 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:27.794021 5661 raft_consensus.cc:1261] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 13:33:27.794452 5771 raft_consensus.cc:1261] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:27.794979 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:27.795662 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:27.784472 7947 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.796234 8192 consensus_queue.cc:1035] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:27.798090 5501 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:27.800622 5769 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:27.800727 5665 raft_consensus.cc:2379] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:27.784088 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:27.802783 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 56020.9us
I20260807 13:33:27.803846 8252 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.804762 8073 consensus_queue.cc:1035] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:27.805812 8016 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:27.814832 5661 raft_consensus.cc:1226] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:27.782996 8209 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.785507 8201 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:27.817885 5499 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:27.790366 8208 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:27.823836 5499 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:27.814565 8202 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:27.827803 8235 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:27.833016 8201 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:27.824084 8208 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:27.829737 7949 consensus_queue.cc:260] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.854305 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.855050 5663 raft_consensus.cc:2379] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:27.820582 8206 raft_consensus.cc:2741] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 13:33:27.831959 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:27.856626 7947 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.832602 8193 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.836206 5769 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:27.836715 5501 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:27.828997 8253 consensus_queue.cc:1035] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 13:33:27.841637 8202 raft_consensus.cc:686] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:27.841872 5662 raft_consensus.cc:1261] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:27.837540 8201 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:27.825536 8209 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:27.813513 8029 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.847034 7980 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.849895 7991 raft_consensus.cc:3032] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Stepping down as leader of term 2
W20260807 13:33:27.853212 8256 log.cc:924] Time spent T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260807 13:33:27.844197 8186 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.859793 5391 catalog_manager.cc:5495] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:27.878731 8191 consensus_queue.cc:1035] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:27.879851 5391 catalog_manager.cc:5495] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:33:27.881454 5391 catalog_manager.cc:5495] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:27.873723 7991 raft_consensus.cc:729] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:27.883157 7991 consensus_queue.cc:260] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.883213 5391 catalog_manager.cc:5495] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 1 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:27.884387 7991 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:27.844074 8236 consensus_queue.cc:1035] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:27.868340 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:33:27.870488 5620 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:27.871582 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.877974 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.888015 5545 raft_consensus.cc:2379] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:27.888805 8202 consensus_queue.cc:237] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.862839 8193 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:27.892447 7853 consensus_queue.cc:1046] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:27.893455 7853 raft_consensus.cc:3032] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:27.887346 8187 ts_tablet_manager.cc:1918] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260807 13:33:27.893836 7853 raft_consensus.cc:729] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:27.894567 5722 leader_election.cc:334] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.680s (SENT)
I20260807 13:33:27.894965 5722 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:27.875473 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:27.895293 7853 consensus_queue.cc:260] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.897157 7853 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:27.898957 8029 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:27.900048 7949 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.872462 7817 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:27.902607 7817 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:27.904196 6681 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 13:33:27.904774 7817 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:27.906394 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:27.861338 8208 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:27.907001 5662 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:27.907217 8187 log.cc:1196] T 93d548887d4245c7b22072e49517a84f P 14f62bf285c448b9b7a21fabd7a5f0bf: Deleting WAL directory at /tmp/dist-test-taskazH1D5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786109494203502-3823-0/minicluster-data/ts-0-root/wals/93d548887d4245c7b22072e49517a84f
I20260807 13:33:27.867520 8201 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:27.908250 5721 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:27.909104 5372 catalog_manager.cc:4841] TS 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): tablet 93d548887d4245c7b22072e49517a84f (table test-workload [id=c88ecb172f5b42d5bf130b8ecd482d61]) successfully deleted
I20260807 13:33:27.909771 7817 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:27.910385 7817 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:27.910874 7817 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.914418 7873 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:33:27.867741 8209 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:27.916189 8209 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.925211 8252 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077) with higher term. Message: Invalid argument: T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4.
I20260807 13:33:27.926061 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.926460 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.926716 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.937186 5543 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:27.937515 5555 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:27.927135 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.938541 5552 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:27.927325 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.928382 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.928685 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.940388 5544 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:27.930019 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.930428 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.943051 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:27.943914 5543 raft_consensus.cc:2354] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:27.944687 5548 raft_consensus.cc:2379] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:27.939826 5542 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:27.937224 5545 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:27.947227 5556 raft_consensus.cc:2396] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 13:33:27.948261 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 77876.8us
I20260807 13:33:27.941354 5553 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:27.949385 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.949906 5553 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:27.950321 8016 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:27.950781 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:27.951318 5553 raft_consensus.cc:2362] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2. Re-sending same reply.
W20260807 13:33:27.951859 5618 leader_election.cc:334] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.518s (SENT)
I20260807 13:33:27.952044 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:27.952309 5618 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:27.952546 5553 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:27.950807 8016 raft_consensus.cc:686] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:27.954433 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.955041 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:27.955597 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:27.955673 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:27.956400 5548 raft_consensus.cc:2362] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3. Re-sending same reply.
I20260807 13:33:27.956593 5545 raft_consensus.cc:2396] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:27.956761 5771 raft_consensus.cc:1261] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:27.957212 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:27.957865 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:27.958012 5722 leader_election.cc:334] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.742s (SENT)
I20260807 13:33:27.948326 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.958729 5543 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:27.960924 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.976716 5545 raft_consensus.cc:2379] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:27.985175 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:27.996371 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.997344 5555 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:27.998413 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:27.999686 5555 raft_consensus.cc:2396] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:28.000485 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.001554 5555 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:28.003007 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.003806 5544 raft_consensus.cc:2379] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:28.004163 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.005898 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.008553 5543 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:27.954205 8020 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:28.020107 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.022303 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.024499 5556 raft_consensus.cc:2362] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2. Re-sending same reply.
I20260807 13:33:28.051234 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.052007 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.052469 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.052743 5556 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:28.053558 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.053561 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.054163 5556 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:28.128509 8260 log.cc:924] Time spent T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.109s user 0.000s sys 0.000s
I20260807 13:33:28.090425 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.130647 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.131737 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.092294 5394 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51200 (request call id 191) took 7787 ms. Trace:
I20260807 13:33:28.094763 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.134923 5542 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:27.996318 7812 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 13:33:28.098796 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 140803us
I20260807 13:33:28.110862 5552 raft_consensus.cc:1261] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:33:28.137858 5552 pending_rounds.cc:76] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 1
I20260807 13:33:28.138207 5552 pending_rounds.cc:97] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:33:28.138506 5552 raft_consensus.cc:2866] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:28.103609 7955 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:28.023603 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 62546.7us
I20260807 13:33:27.875442 7947 consensus_queue.cc:1046] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
I20260807 13:33:27.955084 8016 consensus_queue.cc:237] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:28.139971 5722 leader_election.cc:334] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.846s (SENT)
I20260807 13:33:28.094094 8201 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.210943 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.212038 5555 raft_consensus.cc:2379] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:28.218868 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.220206 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.133044 5394 rpcz_store.cc:276] 0807 13:33:20.235820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:20.260443 (+ 24623us) service_pool.cc:227] Handling call
0807 13:33:28.022803 (+7762360us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:27.145519 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:27.145937 (+ 418us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:27.145961 (+ 24us) write_op.cc:435] Acquired schema lock
0807 13:33:27.145970 (+ 9us) tablet.cc:660] Decoding operations
0807 13:33:27.191973 (+ 46003us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:27.204539 (+ 12566us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:27.211705 (+ 7166us) tablet.cc:683] Acquiring locks for 3 operations
0807 13:33:27.287287 (+ 75582us) tablet.cc:699] Row locks acquired
0807 13:33:27.290314 (+ 3027us) write_op.cc:260] PREPARE: finished
0807 13:33:27.305021 (+ 14707us) write_op.cc:270] Start()
0807 13:33:27.310387 (+ 5366us) write_op.cc:276] Timestamp: P: 1786109607304975 usec, L: 0
0807 13:33:27.312157 (+ 1770us) op_driver.cc:331] REPLICATION: starting
0807 13:33:27.418880 (+106723us) log.cc:842] Serialized 1374 byte log entry
0807 13:33:27.558198 (+139318us) op_driver.cc:444] REPLICATION: finished
0807 13:33:27.733949 (+175751us) write_op.cc:301] APPLY: starting
0807 13:33:27.734059 (+ 110us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:27.734252 (+ 193us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:27.734398 (+ 146us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:27.741691 (+ 7293us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:27.741858 (+ 167us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0807 13:33:27.741899 (+ 41us) write_op.cc:312] APPLY: finished
0807 13:33:27.742123 (+ 224us) log.cc:842] Serialized 34 byte log entry
0807 13:33:27.742283 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:27.742369 (+ 86us) write_op.cc:454] Released schema lock
0807 13:33:27.742414 (+ 45us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:27.742666 (+ 252us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:27.742694 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":196070,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":134817,"apply.run_cpu_time_us":2261,"apply.run_wall_time_us":9050,"num_ops":3,"prepare.queue_time_us":89354,"prepare.run_cpu_time_us":4090,"prepare.run_wall_time_us":282254,"replication_time_us":234120,"thread_start_us":175796,"threads_started":2}]]}
I20260807 13:33:28.227216 5556 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:28.220839 5555 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:28.174654 8239 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.220620 5553 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:28.291923 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.301983 8073 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.302572 8073 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:28.304921 8073 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:28.294793 5553 raft_consensus.cc:1261] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:33:28.254809 5618 leader_election.cc:334] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.574s (SENT)
I20260807 13:33:28.325692 5618 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:28.335762 5555 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:28.337867 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.109556 8248 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.222s
I20260807 13:33:28.217023 8253 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.339920 5543 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:28.342607 5555 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:28.175613 7955 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:28.343503 5660 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s user 0.020s sys 0.017s
W20260807 13:33:28.344039 5660 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s user 0.020s sys 0.017s
I20260807 13:33:28.321954 5542 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:28.245349 8239 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:28.348795 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 94027us
W20260807 13:33:28.335850 8212 log.cc:924] Time spent T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
W20260807 13:33:28.352414 5618 leader_election.cc:334] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.609s (SENT)
W20260807 13:33:28.342653 8260 log.cc:924] Time spent T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.102s user 0.000s sys 0.000s
I20260807 13:33:28.353500 5762 raft_consensus.cc:1261] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:28.232373 8206 consensus_queue.cc:1046] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260807 13:33:28.289959 7853 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.346065 7856 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:28.348649 8236 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.358023 5618 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:28.362761 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:28.358655 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.365378 5666 raft_consensus.cc:2379] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:28.370708 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.371256 5556 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:28.365144 8206 consensus_queue.cc:1225] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 0b9aca0aafaa43e7998ee8f3e59627e0 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:33:28.362301 7853 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.349759 8253 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:28.373039 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:28.362551 8252 consensus_queue.cc:1035] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260807 13:33:28.369166 7856 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:28.379814 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:28.402465 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 226549us
I20260807 13:33:28.414434 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:28.451731 8264 log.cc:924] Time spent T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.109s user 0.000s sys 0.001s
I20260807 13:33:28.505245 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.530849 5555 raft_consensus.cc:2354] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:28.531973 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.532972 5555 raft_consensus.cc:2354] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:28.534292 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:28.505920 7949 consensus_meta.cc:287] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.605s user 0.009s sys 0.001s
W20260807 13:33:28.448078 8208 consensus_meta.cc:287] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.540s user 0.009s sys 0.000s
W20260807 13:33:28.499233 8209 consensus_meta.cc:287] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.583s user 0.011s sys 0.000s
I20260807 13:33:28.540693 5554 raft_consensus.cc:2354] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4.
I20260807 13:33:28.423421 5545 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
W20260807 13:33:28.469995 8265 log.cc:924] Time spent T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.244s user 0.001s sys 0.000s
W20260807 13:33:28.478657 8274 log.cc:924] Time spent T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.125s user 0.001s sys 0.000s
I20260807 13:33:28.536566 5556 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:28.538501 5552 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:28.563557 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.430586 8285 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.431092 8201 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:28.499527 8239 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:28.535434 5656 consensus_meta.cc:287] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.580s user 0.010s sys 0.001s
I20260807 13:33:28.538834 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.586149 5555 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:28.584859 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.587105 5545 raft_consensus.cc:2362] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4. Re-sending same reply.
W20260807 13:33:28.566370 5722 leader_election.cc:334] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.988s (SENT)
I20260807 13:33:28.588515 5722 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:28.591158 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.593917 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.377161 7817 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:28.596297 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 243872us
I20260807 13:33:28.369170 8236 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:28.602684 8239 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 13:33:28.378132 5372 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet fc6f41d0f11d4c6295bae40c23631a4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 14f62bf285c448b9b7a21fabd7a5f0bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
W20260807 13:33:28.603716 5372 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 230463us
I20260807 13:33:28.589620 5656 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:28.608235 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.608843 5556 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:28.609647 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.610214 5556 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:28.613083 7853 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:28.596428 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.620302 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:28.628072 5552 raft_consensus.cc:2354] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:28.615532 5555 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:28.597643 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.629736 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:28.631774 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.632083 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.632424 5771 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:28.632687 5767 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:28.633627 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.634203 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:28.619930 6637 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:28.579720 7955 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:28.541745 8209 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.540313 8208 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.562857 6685 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:28.626698 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.641723 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.580683 7959 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:28.628837 5618 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.613s (SENT) [suppressed 44 similar messages]
I20260807 13:33:28.637955 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:28.638975 5771 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:28.653115 5501 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:28.639113 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:28.638165 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 288710us
I20260807 13:33:28.635094 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.639240 5556 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:28.655741 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.656436 5501 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:28.657330 5501 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
W20260807 13:33:28.616566 8273 log.cc:924] Time spent T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.097s user 0.000s sys 0.001s
I20260807 13:33:28.644800 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.653196 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:28.620887 8253 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:28.643921 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.656237 5556 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:28.651980 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.671823 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.672411 5545 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:28.672178 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.666433 5771 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:28.673420 5659 raft_consensus.cc:1261] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:28.669090 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.670043 5548 raft_consensus.cc:2354] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
W20260807 13:33:28.673974 5618 leader_election.cc:334] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.683s (SENT)
I20260807 13:33:28.674356 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:28.670753 5544 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:28.667086 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:28.670504 5765 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:28.677184 5722 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:28.641502 8288 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.680922 5769 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:28.641693 7853 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:28.647970 8172 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:28.682881 5722 leader_election.cc:398] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:28.590158 8285 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.688203 5722 leader_election.cc:401] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 13:33:28.688371 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.689138 5763 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:28.685250 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:28.685350 5618 leader_election.cc:334] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.708s (SENT)
W20260807 13:33:28.685997 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 321703us
I20260807 13:33:28.690316 5618 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:28.664726 7949 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:28.664546 8201 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:28.669219 7955 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:28.701639 5662 raft_consensus.cc:1261] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 13:33:28.692041 5618 leader_election.cc:334] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.733s (SENT)
I20260807 13:33:28.696489 5722 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:28.696910 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.702379 5618 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:28.697738 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.698292 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.699627 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.703485 5556 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:28.703564 5769 raft_consensus.cc:2379] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:28.703703 5554 raft_consensus.cc:2396] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:28.705052 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:28.705659 5661 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:28.681298 8239 raft_consensus.cc:2741] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 13:33:28.707429 5499 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:28.708205 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.708596 5545 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:28.708858 5770 raft_consensus.cc:1261] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:28.651396 7959 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.711072 5554 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:28.711252 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.687911 7856 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.714423 5771 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:28.711491 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.717628 5771 raft_consensus.cc:1261] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:28.718433 5545 raft_consensus.cc:1261] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:28.721467 8208 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:28.721189 5545 raft_consensus.cc:1261] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:28.722831 6637 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:28.695672 5761 raft_consensus.cc:1261] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:28.687920 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.688161 8172 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:28.724723 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:28.701555 7955 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:28.691701 8258 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.741367 8296 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:28.729862 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:28.691879 8215 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:28.728514 5618 leader_election.cc:334] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.767s (SENT)
I20260807 13:33:28.736114 5722 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:28.746656 5722 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:28.736862 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:28.691895 7890 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.692112 7853 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:28.741339 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:28.742223 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.755338 5763 raft_consensus.cc:2396] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:28.729624 7856 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.695571 8073 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:28.749086 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:28.749717 5552 raft_consensus.cc:2396] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:28.724723 8201 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:28.724953 7991 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:28.704624 8019 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.743093 5766 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:28.753538 5556 raft_consensus.cc:3032] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:28.743772 8253 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:28.761260 5663 raft_consensus.cc:1261] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:28.745333 7812 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.751134 8240 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:28.761047 5665 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:28.729620 5554 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:38210
I20260807 13:33:28.784616 5554 raft_consensus.cc:595] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:28.785033 5554 raft_consensus.cc:603] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:28.744192 7955 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:28.767158 5556 raft_consensus.cc:729] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:28.741158 8172 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:28.769232 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:28.790663 5763 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:28.749791 8258 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:28.771464 5722 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:28.772070 5552 raft_consensus.cc:1261] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260807 13:33:28.773104 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 44634us
I20260807 13:33:28.763792 7669 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:28.772754 8285 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:28.774367 5548 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:28.685997 8288 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.806654 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.807307 5770 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:28.742163 5656 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:28.782243 5764 raft_consensus.cc:1799] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Handling vote request from an unknown peer 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:28.809247 5764 raft_consensus.cc:2396] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260807 13:33:28.750543 8236 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:28.813293 8289 log.cc:924] Time spent T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.115s user 0.001s sys 0.000s
I20260807 13:33:28.813578 8236 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:28.772796 8019 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:28.799046 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 48525.4us
I20260807 13:33:28.801080 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:28.760432 7890 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.801908 5556 consensus_queue.cc:260] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.838058 5556 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:28.803876 5554 raft_consensus.cc:1226] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:28.805195 5618 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:28.819458 5661 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:28.841501 5553 raft_consensus.cc:1226] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:28.794346 8240 raft_consensus.cc:686] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:28.793459 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:28.799816 7669 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:28.806852 8209 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:28.801394 7817 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:28.786347 7812 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.861130 5554 raft_consensus.cc:1261] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:28.873853 5770 raft_consensus.cc:1261] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:28.874239 5556 raft_consensus.cc:1261] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:33:28.870362 5553 raft_consensus.cc:1226] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:28.856865 8285 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 13:33:28.859880 8295 log.cc:924] Time spent T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
W20260807 13:33:28.878594 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 87227us
I20260807 13:33:28.884238 5556 pending_rounds.cc:76] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 2
I20260807 13:33:28.888196 5556 pending_rounds.cc:97] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:33:28.888578 5556 raft_consensus.cc:2866] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 13:33:28.890417 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 85336.6us
I20260807 13:33:28.891784 5618 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:28.893008 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:28.873582 5658 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:28.873385 7669 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:28.895457 5770 raft_consensus.cc:2379] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:28.896545 5553 raft_consensus.cc:1226] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:28.896332 5499 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:28.874251 8253 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.902300 5556 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 13:33:28.883486 8201 raft_consensus.cc:686] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:28.877902 7949 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:28.908957 5553 raft_consensus.cc:1226] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:28.904184 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:28.891305 8016 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:28.945072 5542 raft_consensus.cc:1226] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:28.946123 5618 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:28.955673 5618 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:28.947165 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 175760us
I20260807 13:33:28.957149 5722 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:28.890455 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 123574us
I20260807 13:33:28.958076 5770 raft_consensus.cc:1261] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:28.959764 5722 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:28.903789 7856 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:28.891860 8209 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260807 13:33:28.984565 5618 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:28.943693 7817 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:28.960865 8289 log.cc:924] Time spent T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260807 13:33:28.955585 7959 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:28.953449 8016 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:28.955385 8288 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:28.999620 5618 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:29.003717 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 93742.9us
W20260807 13:33:29.005801 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 117918us
I20260807 13:33:28.973727 8252 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:28.919358 8253 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:28.953595 7949 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:28.982537 7933 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.011381 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:29.006073 8016 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:29.011790 8335 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:29.000923 8208 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:29.002555 7853 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:29.024289 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 64627.2us
I20260807 13:33:29.016151 6694 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:29.035243 5503 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:29.013228 8239 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:29.036415 5722 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:29.041038 8239 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:29.041580 8239 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.013662 8327 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 13:33:29.043483 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 43965.1us
I20260807 13:33:29.047446 5618 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:29.001318 6636 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:29.036229 7856 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:29.045207 7890 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.005084 7817 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:29.002683 8201 consensus_queue.cc:237] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.037698 8019 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.043817 7933 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.075199 5618 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:28.961293 8240 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:29.076443 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:29.045485 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:29.073009 8252 raft_consensus.cc:686] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:29.071568 7812 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:29.076335 7890 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
W20260807 13:33:29.076985 8302 log.cc:924] Time spent T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.203s user 0.000s sys 0.001s
I20260807 13:33:29.070904 7856 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:29.105327 8344 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:29.044205 8258 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:29.107617 8306 log.cc:924] Time spent T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.137s user 0.000s sys 0.001s
W20260807 13:33:29.108348 8317 log.cc:924] Time spent T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.110s user 0.000s sys 0.001s
W20260807 13:33:29.108978 8300 log.cc:924] Time spent T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.205s user 0.000s sys 0.001s
I20260807 13:33:29.110023 8324 consensus_queue.cc:1035] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:29.111406 8345 consensus_queue.cc:1046] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260807 13:33:29.103688 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 118063us
W20260807 13:33:29.112563 8304 log.cc:924] Time spent T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.217s user 0.001s sys 0.001s
I20260807 13:33:29.189533 5501 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:29.119333 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 995) took 1098 ms. Trace:
I20260807 13:33:29.119472 5554 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:29.053189 7853 consensus_queue.cc:1046] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260807 13:33:29.112849 7669 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.123435 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:29.193243 5764 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.190132 5544 rpcz_store.cc:276] 0807 13:33:28.020800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:28.131510 (+110710us) service_pool.cc:227] Handling call
0807 13:33:29.119049 (+987539us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54000dff54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:29.119256 (+ 207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1237822336}
I20260807 13:33:29.126559 5765 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:29.127439 8016 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:29.168007 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 92868.9us
I20260807 13:33:29.194623 5765 raft_consensus.cc:595] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:29.195024 5618 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:29.144045 8020 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:33:29.173022 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 95290.4us
I20260807 13:33:29.179237 8319 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:33:29.179646 8328 log.cc:924] Time spent T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.077s user 0.001s sys 0.000s
I20260807 13:33:29.182843 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:29.163259 7856 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.163326 8344 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:29.182015 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:29.187294 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1002) took 1133 ms. Trace:
I20260807 13:33:29.207458 5763 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:29.190708 5501 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:29.157929 5761 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:29.166893 7890 raft_consensus.cc:686] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:29.203583 5618 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:29.162731 8208 raft_consensus.cc:686] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:29.212371 5666 raft_consensus.cc:1226] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:29.207816 5545 rpcz_store.cc:276] 0807 13:33:28.054023 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:28.722707 (+668684us) service_pool.cc:227] Handling call
0807 13:33:28.722982 (+ 275us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:28.723285 (+ 303us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:28.723309 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:28.723699 (+ 390us) log.cc:842] Serialized 26 byte log entry
0807 13:33:28.874938 (+151239us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:28.900083 (+ 25145us) log.cc:842] Serialized 14 byte log entry
0807 13:33:28.900316 (+ 233us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:28.900440 (+ 124us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:29.186999 (+286559us) raft_consensus.cc:1671] finished
0807 13:33:29.187032 (+ 33us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:29.187214 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":213,"prepare.queue_time_us":24857,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":66034,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6254,"spinlock_wait_cycles":6070528,"thread_start_us":148842,"threads_started":1,"wal-append.queue_time_us":184589}
I20260807 13:33:29.185784 8239 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.220233 8239 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:29.204461 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 188724us
I20260807 13:33:29.169812 8253 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.210657 5501 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:29.204104 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 199592us
I20260807 13:33:29.212218 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:29.192200 8215 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:29.199826 8248 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:29.198141 8327 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:29.200378 8319 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:29.239253 5618 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:29.235333 8209 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.240686 8338 consensus_queue.cc:1046] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260807 13:33:29.241722 8338 raft_consensus.cc:3032] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:29.242022 8338 raft_consensus.cc:729] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:29.242805 8338 consensus_queue.cc:260] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:29.243893 8338 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.244408 7933 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:29.245410 7933 consensus_queue.cc:1046] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:29.247267 8346 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.247921 8355 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:29.249296 8016 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.249476 5618 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:29.249852 8016 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:29.250391 8016 raft_consensus.cc:686] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:29.251420 5618 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:29.251298 8016 consensus_queue.cc:237] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.252432 5618 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:29.252888 7669 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:29.212646 8258 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.253429 8019 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:29.254099 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:29.254436 8360 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:29.254570 8020 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 13:33:29.255048 8360 raft_consensus.cc:686] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:29.255241 8020 raft_consensus.cc:686] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:29.255956 8360 consensus_queue.cc:237] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.256124 8020 consensus_queue.cc:237] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.257583 8319 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.227111 7817 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:29.245787 7890 consensus_queue.cc:237] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.225201 7949 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.213233 8344 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.211572 8347 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260807 13:33:29.234241 5501 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:29.285281 5667 raft_consensus.cc:1261] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:29.262293 8208 consensus_queue.cc:237] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.245371 5764 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:29.236001 5767 raft_consensus.cc:1261] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 13:33:29.287639 5767 pending_rounds.cc:76] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 1
I20260807 13:33:29.287863 5767 pending_rounds.cc:97] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 13:33:29.288151 5767 raft_consensus.cc:2866] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:29.234284 8253 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:29.282971 5659 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:29.250423 8333 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:29.268072 8215 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:29.196343 8252 consensus_queue.cc:237] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.295905 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:29.296281 5767 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260807 13:33:29.296466 5764 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
W20260807 13:33:29.292840 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 58711.7us
I20260807 13:33:29.253391 7669 raft_consensus.cc:3032] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
W20260807 13:33:29.290874 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 87476.9us
I20260807 13:33:29.284150 5658 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:29.297987 5501 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:29.313771 5501 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:29.318056 5722 leader_election.cc:334] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.007s (SENT)
I20260807 13:33:29.318336 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:29.319095 5764 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:29.297399 8191 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.309736 8345 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260807 13:33:29.326508 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:29.327616 5659 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:29.329474 5501 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:29.332929 5501 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:29.302533 7669 raft_consensus.cc:729] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:29.352097 5767 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:29.352824 5767 raft_consensus.cc:595] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:29.353817 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:29.355384 8346 consensus_queue.cc:1035] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:29.356118 5499 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:29.357242 8346 consensus_queue.cc:1035] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:29.357774 8322 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:29.358884 8346 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:29.358982 8322 consensus_queue.cc:1225] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 0b9aca0aafaa43e7998ee8f3e59627e0 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:33:29.359738 8346 raft_consensus.cc:686] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:29.357194 5499 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:29.361207 8206 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:29.360867 8346 consensus_queue.cc:237] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.361688 8206 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:29.363608 8206 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:29.365700 5620 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:29.365567 8019 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:29.367234 8019 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:29.367695 8019 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:29.368167 8019 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:29.368259 5620 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:29.370532 8020 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:29.370744 5555 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:38210
I20260807 13:33:29.371008 8020 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:29.371352 5555 raft_consensus.cc:595] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:29.371564 8020 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:29.371734 5555 raft_consensus.cc:603] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:29.367590 5501 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:29.293303 8253 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:29.315392 8236 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:33:29.345387 7955 consensus_meta.cc:287] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.545s user 0.008s sys 0.002s
I20260807 13:33:29.294389 8215 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.342780 8347 raft_consensus.cc:2741] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 13:33:29.431695 5761 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
W20260807 13:33:29.438979 8369 log.cc:924] Time spent T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.122s user 0.000s sys 0.001s
I20260807 13:33:29.439039 5761 raft_consensus.cc:595] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:29.439590 5761 raft_consensus.cc:603] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:29.434741 5501 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:29.431900 8208 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:29.453902 5501 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:29.450986 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 13:33:29.442514 8347 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:29.429600 8239 consensus_queue.cc:1046] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260807 13:33:29.464855 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:29.430358 7955 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.440017 7669 consensus_queue.cc:260] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.436910 8191 consensus_queue.cc:1035] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260807 13:33:29.471573 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 219197us
I20260807 13:33:29.472484 5618 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:29.455297 8322 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:33:29.462901 8029 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260807 13:33:29.459925 8341 raft_consensus.cc:2741] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 13:33:29.475466 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:29.486666 6694 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:29.469133 7991 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:29.472692 8172 consensus_meta.cc:287] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 0.672s user 0.011s sys 0.000s
I20260807 13:33:29.497129 8364 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:29.497704 7856 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.500028 7856 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.500240 8206 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.501781 7955 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.475145 8335 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.510324 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:29.480728 8279 log.cc:924] Time spent T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.835s user 0.000s sys 0.005s
I20260807 13:33:29.511013 5663 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:29.487099 5618 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:29.510329 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:29.512759 5661 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 6
I20260807 13:33:29.513617 5618 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:29.514035 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:29.516104 8292 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:29.520699 8020 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.493081 8073 consensus_queue.cc:1035] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260807 13:33:29.510524 8172 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:29.470696 7980 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260807 13:33:29.462534 8353 consensus_queue.cc:1035] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
I20260807 13:33:29.479910 8333 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:29.527657 5661 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:29.528249 5663 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:29.531963 5618 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:29.550776 5499 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:29.470072 8347 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.504588 7991 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:29.547927 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 91403.8us
I20260807 13:33:29.568392 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:29.569238 5661 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:29.571754 5618 leader_election.cc:398] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:29.572041 5618 leader_election.cc:401] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260807 13:33:29.527491 8323 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.572294 5499 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:29.574942 8341 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:29.573432 7856 consensus_queue.cc:1035] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 13:33:29.576254 6688 raft_consensus.cc:1226] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:29.575402 8172 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:29.551155 8264 log.cc:924] Time spent T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.056s user 0.003s sys 0.006s
I20260807 13:33:29.531651 8206 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.549106 8353 consensus_queue.cc:1225] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:33:29.552321 8367 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:29.552109 8346 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:29.547809 8292 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.555588 8215 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:29.548847 8333 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:29.592410 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:29.553642 8376 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:29.586589 8341 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:29.587849 8335 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:29.604993 5501 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:29.593403 8253 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.612789 5501 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:29.615623 8403 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.616750 8019 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.617874 5667 raft_consensus.cc:1226] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:29.619550 8029 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.620608 5621 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:29.621222 7959 raft_consensus.cc:3032] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:29.621735 7959 raft_consensus.cc:729] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:29.621935 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:29.622548 5764 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:29.622805 7959 consensus_queue.cc:260] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.624181 7959 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:29.625176 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:29.602257 8333 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:29.599295 8346 raft_consensus.cc:686] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:29.588581 8252 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260807 13:33:29.631966 5764 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:29.588207 6636 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:29.662734 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:29.632603 5501 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:29.676352 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 43791us
I20260807 13:33:29.675040 5620 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:29.594312 8016 consensus_queue.cc:1035] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260807 13:33:29.601934 8376 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:29.703467 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:29.704311 5764 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:29.705494 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:29.706895 5767 raft_consensus.cc:1226] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:29.709712 5770 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:29.711381 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:29.712184 5767 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 2.
I20260807 13:33:29.611764 8347 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.713922 5764 pending_rounds.cc:76] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 2
I20260807 13:33:29.717412 5555 raft_consensus.cc:1261] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:29.799048 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:29.579000 8319 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:29.661958 8019 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.745988 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:29.754905 8355 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:33:29.747155 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 46535.6us
I20260807 13:33:29.612412 8341 raft_consensus.cc:686] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:29.754484 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:29.771044 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:29.775583 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 110378us
I20260807 13:33:29.663404 8288 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:29.603888 8191 consensus_queue.cc:1046] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260807 13:33:29.694873 8206 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:29.819995 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:29.690299 8335 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:29.739414 7890 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:29.820657 5543 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.821209 7890 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:29.821139 8335 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:29.822217 8335 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.770212 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:29.826558 7991 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:29.692787 8029 consensus_queue.cc:1035] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260807 13:33:29.800909 5770 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:29.828998 8341 consensus_queue.cc:237] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.760844 8253 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:29.834386 8253 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:29.806330 8322 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:29.740734 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 163447us
I20260807 13:33:29.803774 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:29.841791 5542 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:29.809672 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:29.799830 5764 pending_rounds.cc:97] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260807 13:33:29.811121 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:29.845083 5764 raft_consensus.cc:2866] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:29.816422 5548 raft_consensus.cc:2379] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:29.818406 6685 raft_consensus.cc:2354] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:29.818162 8016 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:29.819587 8372 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:29.821663 7890 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.826478 5761 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:29.744568 8376 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:29.793023 8367 raft_consensus.cc:686] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:29.835039 8253 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:29.836397 5543 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:29.661913 7856 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:29.722092 8073 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:29.815537 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:29.869225 5767 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 7
W20260807 13:33:29.805776 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 213665us
I20260807 13:33:29.847612 5556 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
W20260807 13:33:29.826013 8303 log.cc:924] Time spent T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.840s user 0.000s sys 0.003s
I20260807 13:33:29.860524 5543 raft_consensus.cc:1226] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:29.816191 8020 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:29.864224 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:29.873293 5665 raft_consensus.cc:1261] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:29.852507 8191 consensus_queue.cc:1225] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:33:29.887388 5556 raft_consensus.cc:1226] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:29.889295 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:29.836493 8346 consensus_queue.cc:237] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.891150 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:29.891878 5543 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:29.857662 8372 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:29.905200 6637 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:29.871812 8201 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:29.911150 5770 raft_consensus.cc:1261] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:29.911036 8201 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:29.912832 8367 consensus_queue.cc:237] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.907836 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:29.915362 5542 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:29.916397 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:29.917094 5556 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:29.846751 8288 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.902379 5767 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:29.926954 5556 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:29.931684 5542 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 13:33:29.932334 5767 raft_consensus.cc:1261] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:29.851670 8322 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.871855 7856 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:29.940495 5722 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:29.880281 8073 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:30.055311 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 137933us
I20260807 13:33:29.997485 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:33:29.928154 8029 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:30.044512 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1041) took 1393 ms. Trace:
I20260807 13:33:29.923637 8206 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:29.920601 7884 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:30.050807 5767 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 13:33:30.066252 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 125850us
I20260807 13:33:30.081533 5666 rpcz_store.cc:276] 0807 13:33:28.651314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:28.651431 (+ 117us) service_pool.cc:227] Handling call
0807 13:33:29.120988 (+469557us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:29.121251 (+ 263us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:29.212806 (+ 91555us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:29.997368 (+784562us) spinlock_profiling.cc:243] Waited 90.9 ms on lock 0x7b540007e4d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:30.044448 (+ 47080us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":218692352}
I20260807 13:33:30.082265 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1004) took 2757 ms. Trace:
I20260807 13:33:29.941649 8239 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260807 13:33:30.053242 8355 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260807 13:33:30.206259 8288 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:30.182799 8373 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:30.210177 8373 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:30.079867 8344 consensus_meta.cc:287] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.791s user 0.010s sys 0.010s
I20260807 13:33:30.214763 5722 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:30.211804 8322 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.179486 8372 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:30.159446 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 558734us
I20260807 13:33:30.182893 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:30.124718 7856 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.190529 7817 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:30.055940 7949 raft_consensus.cc:3032] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
W20260807 13:33:30.162055 8409 log.cc:924] Time spent T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.335s user 0.001s sys 0.001s
W20260807 13:33:30.128197 8404 log.cc:924] Time spent T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.187s user 0.000s sys 0.002s
I20260807 13:33:30.312841 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 894) took 2279 ms. Trace:
I20260807 13:33:30.142843 8358 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:30.216324 5660 rpcz_store.cc:276] 0807 13:33:27.315786 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:27.315936 (+ 150us) service_pool.cc:227] Handling call
0807 13:33:27.702827 (+386891us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:27.723880 (+ 21053us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:27.723922 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:27.774632 (+ 50710us) log.cc:842] Serialized 26 byte log entry
0807 13:33:28.344441 (+569809us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:28.344485 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:28.344569 (+ 84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:29.325207 (+980638us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:29.530516 (+205309us) raft_consensus.cc:1671] finished
0807 13:33:29.530541 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:30.072728 (+542187us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54000cf650. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:30.073055 (+ 327us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":994,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":32215,"spinlock_wait_cycles":891971328,"thread_start_us":559309,"threads_started":1,"wal-append.queue_time_us":690750}
I20260807 13:33:30.217584 8073 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.375348 7817 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:30.163830 8201 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:30.122792 8319 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.354261 8172 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:30.384362 8172 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:30.312590 8288 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:30.224972 8258 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:30.387580 8288 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.388558 8258 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.316752 8208 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:30.390479 8208 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:30.394647 7890 consensus_meta.cc:287] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.541s user 0.010s sys 0.006s
I20260807 13:33:30.395212 7890 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.398387 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:30.400719 7817 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:30.402913 8288 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:30.357290 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 142623us
I20260807 13:33:30.372144 8412 consensus_queue.cc:1046] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260807 13:33:30.367874 7949 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:30.093582 8029 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.375487 5553 rpcz_store.cc:276] 0807 13:33:27.960774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:28.944668 (+983894us) service_pool.cc:227] Handling call
0807 13:33:30.239356 (+1294688us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b54003976d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:30.240083 (+ 727us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35074304}
I20260807 13:33:30.216043 7884 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:30.369058 8372 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:30.405930 5722 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:30.353701 5761 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:30.112196 8206 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.392375 8258 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.414619 8186 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:30.378472 8358 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:30.414924 8073 raft_consensus.cc:3032] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:30.225646 8344 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:30.453416 8371 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:30.457530 8029 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.451186 8073 raft_consensus.cc:729] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:30.418802 8208 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:30.425717 8376 consensus_meta.cc:287] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.557s user 0.007s sys 0.010s
W20260807 13:33:30.427119 8333 consensus_meta.cc:287] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.704s user 0.014s sys 0.002s
I20260807 13:33:30.418140 7884 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:30.419380 8239 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:30.418869 8372 raft_consensus.cc:686] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:30.425902 8172 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.478987 5555 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:30.449041 8358 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:30.419853 7817 consensus_queue.cc:1046] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260807 13:33:30.454018 8373 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:30.518257 8347 raft_consensus.cc:3032] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:30.519008 8347 raft_consensus.cc:729] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:30.520522 8347 consensus_queue.cc:260] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.478394 7890 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.523386 8347 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:30.524982 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:30.470386 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:30.451424 8186 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.525918 6694 raft_consensus.cc:2379] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:30.492210 8288 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:30.414623 7949 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.530732 8073 consensus_queue.cc:260] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:30.499179 8206 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.498796 8239 raft_consensus.cc:686] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:30.593799 8345 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:30.482908 8371 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.678071 8363 raft_consensus.cc:3032] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:30.678568 8363 raft_consensus.cc:729] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:30.680891 8371 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:30.618335 7812 raft_consensus.cc:3032] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:30.681731 7812 raft_consensus.cc:729] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:30.682731 7812 consensus_queue.cc:260] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.684584 7812 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:30.687116 8363 consensus_queue.cc:260] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.590868 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:30.721002 6694 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:30.658639 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54374 (request call id 897) took 1411 ms. Trace:
I20260807 13:33:30.721799 5545 rpcz_store.cc:276] 0807 13:33:29.246801 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.260460 (+ 13659us) service_pool.cc:227] Handling call
0807 13:33:30.658223 (+1397763us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003976d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237c7c5 00007ff682374c1a 00007ff6872b86d9 00007ff6809a2184 00007ff6809a2112 00007ff6809a2041 00007ff6809a1fbc 00007ff6809a1272 00007ff6807a094c 00007ff68079fd86
0807 13:33:30.658516 (+ 293us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2802767616}
I20260807 13:33:30.602124 8193 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:30.648124 8385 log.cc:924] Time spent T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 1.028s user 0.002s sys 0.002s
W20260807 13:33:30.601330 8253 consensus_meta.cc:287] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 0.729s user 0.009s sys 0.007s
I20260807 13:33:30.569533 8288 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:30.538952 8335 consensus_meta.cc:287] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.716s user 0.011s sys 0.005s
I20260807 13:33:30.598023 8372 consensus_queue.cc:237] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.608686 7669 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:30.480919 8333 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:30.690361 8345 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.655344 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:30.478504 8376 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.736871 8335 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:30.748064 8345 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:30.070559 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:33:30.745500 8288 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:30.706981 7949 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:30.734473 8253 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:30.697914 6685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37838 (request call id 109) took 1464 ms. Trace:
I20260807 13:33:30.754614 6680 raft_consensus.cc:1226] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:30.754499 6685 rpcz_store.cc:276] 0807 13:33:29.233518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.253737 (+ 20219us) service_pool.cc:227] Handling call
0807 13:33:30.697549 (+1443812us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54003cd2d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:30.697812 (+ 263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1290707840}
I20260807 13:33:30.757360 5725 leader_election.cc:398] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077) with higher term. Message: Invalid argument: T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:30.757723 5725 leader_election.cc:401] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:30.714324 8073 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:30.696310 8397 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:30.692970 8206 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:30.759570 8335 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:30.775027 8206 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.580237 8344 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:30.708472 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1004) took 2099 ms. Trace:
I20260807 13:33:30.777805 5554 rpcz_store.cc:276] 0807 13:33:28.609213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:28.885634 (+276421us) service_pool.cc:227] Handling call
0807 13:33:29.119228 (+233594us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:29.190737 (+ 71509us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:30.708218 (+1517481us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54000dff50. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:30.708378 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":536373504}
W20260807 13:33:30.719453 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 58341us
I20260807 13:33:30.717743 5391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36640 (request call id 67) took 3557 ms. Trace:
I20260807 13:33:30.568145 5761 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 5
I20260807 13:33:30.717760 8239 consensus_queue.cc:237] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.792379 8206 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.707412 8186 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.785245 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:30.788528 8253 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.790273 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:30.790351 5656 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:30.791194 8397 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.731276 8193 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.758128 6680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37838 (request call id 108) took 2219 ms. Trace:
I20260807 13:33:30.735726 8363 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:30.749919 8376 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:30.806855 8345 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:30.819613 8333 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:30.824196 7873 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:30.867120 8016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.991s user 0.018s sys 0.052s
I20260807 13:33:30.863345 7959 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:30.928574 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.067s user 0.006s sys 0.040s
W20260807 13:33:30.928959 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.068s user 0.006s sys 0.040s
I20260807 13:33:30.837100 6694 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:30.838071 8344 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:30.837751 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
W20260807 13:33:30.867240 5544 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s user 0.017s sys 0.055s
W20260807 13:33:30.885442 5543 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.985s user 0.023s sys 0.056s
I20260807 13:33:30.901762 7817 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:30.926982 8016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.048s user 0.019s sys 0.058s
I20260807 13:33:30.889827 8371 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:30.906831 8373 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:30.928326 6685 raft_consensus.cc:2379] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
W20260807 13:33:30.959458 5543 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.059s user 0.023s sys 0.056s
W20260807 13:33:30.959378 5544 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.146s user 0.017s sys 0.055s
I20260807 13:33:31.000763 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1016) took 1282 ms. Trace:
I20260807 13:33:30.910854 8070 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:30.830427 5391 rpcz_store.cc:276] 0807 13:33:27.160098 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:27.160861 (+ 763us) service_pool.cc:227] Handling call
0807 13:33:30.717637 (+3556776us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:28.368638 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:28.478477 (+109839us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:28.493077 (+ 14600us) write_op.cc:435] Acquired schema lock
0807 13:33:28.497929 (+ 4852us) tablet.cc:660] Decoding operations
0807 13:33:28.608658 (+110729us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:28.608765 (+ 107us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:28.608803 (+ 38us) tablet.cc:683] Acquiring locks for 4 operations
0807 13:33:28.609321 (+ 518us) tablet.cc:699] Row locks acquired
0807 13:33:28.609347 (+ 26us) write_op.cc:260] PREPARE: finished
0807 13:33:28.609541 (+ 194us) write_op.cc:270] Start()
0807 13:33:28.609701 (+ 160us) write_op.cc:276] Timestamp: P: 1786109608609483 usec, L: 0
0807 13:33:28.609731 (+ 30us) op_driver.cc:331] REPLICATION: starting
0807 13:33:28.610566 (+ 835us) log.cc:842] Serialized 1681 byte log entry
0807 13:33:28.955236 (+344670us) op_driver.cc:444] REPLICATION: finished
0807 13:33:29.234607 (+279371us) write_op.cc:301] APPLY: starting
0807 13:33:29.236718 (+ 2111us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:29.265584 (+ 28866us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:29.265700 (+ 116us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:29.286886 (+ 21186us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:29.299991 (+ 13105us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0807 13:33:29.306482 (+ 6491us) write_op.cc:312] APPLY: finished
0807 13:33:29.392922 (+ 86440us) log.cc:842] Serialized 40 byte log entry
0807 13:33:29.430272 (+ 37350us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:29.435250 (+ 4978us) write_op.cc:454] Released schema lock
0807 13:33:29.441625 (+ 6375us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:29.457023 (+ 15398us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:29.458056 (+ 1033us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32796,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":241148,"apply.run_cpu_time_us":3376,"apply.run_wall_time_us":239960,"mutex_wait_us":9225,"num_ops":4,"prepare.queue_time_us":404862,"prepare.run_cpu_time_us":4679,"prepare.run_wall_time_us":251357,"replication_time_us":301540,"thread_start_us":268096,"threads_started":2}]]}
I20260807 13:33:30.925716 5389 catalog_manager.cc:5495] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:33:30.997705 5501 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.078s user 0.021s sys 0.024s
I20260807 13:33:31.001173 5544 rpcz_store.cc:276] 0807 13:33:29.718622 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.718750 (+ 128us) service_pool.cc:227] Handling call
0807 13:33:29.719042 (+ 292us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:29.719220 (+ 178us) raft_consensus.cc:1520] Early marking committed up to index 6
0807 13:33:29.813550 (+ 94330us) log.cc:842] Serialized 14 byte log entry
0807 13:33:31.000381 (+1186831us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:31.000433 (+ 52us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:33:31.000496 (+ 63us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:31.000569 (+ 73us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:31.000712 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":267046,"prepare.run_cpu_time_us":335,"prepare.run_wall_time_us":6388,"thread_start_us":1280518,"threads_started":2}
I20260807 13:33:30.959308 7669 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:31.015846 5501 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.096s user 0.022s sys 0.024s
I20260807 13:33:30.914314 8345 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.914505 7873 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.963551 8016 raft_consensus.cc:686] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:30.955319 7949 consensus_queue.cc:1035] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260807 13:33:30.933745 7959 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:30.959749 8186 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:31.055465 5548 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.971s user 0.022s sys 0.055s
I20260807 13:33:30.943864 8344 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.047902 5501 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:31.003319 8335 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:30.963135 8346 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s user 0.018s sys 0.023s
W20260807 13:33:31.018857 8364 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.178s user 0.020s sys 0.081s
W20260807 13:33:31.059721 5548 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.975s user 0.023s sys 0.055s
I20260807 13:33:31.018291 8323 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.031240 5389 catalog_manager.cc:5495] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 2 to 3, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 3 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:30.907629 6680 rpcz_store.cc:276] 0807 13:33:28.538439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:28.539792 (+ 1353us) service_pool.cc:227] Handling call
0807 13:33:29.868720 (+1328928us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b5800005498. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:29.888970 (+ 20250us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:30.755423 (+866453us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:30.757258 (+ 1835us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54005a37d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:30.757957 (+ 699us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1996289024}
I20260807 13:33:30.991693 7817 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:31.003497 8333 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:31.069007 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:31.090999 5555 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:31.003108 8206 consensus_queue.cc:1046] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260807 13:33:31.054085 8201 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.082463 5389 catalog_manager.cc:5495] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.046756 8236 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:31.052876 8417 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.087139 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:30.999635 8371 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:31.070786 8346 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s user 0.018s sys 0.024s
I20260807 13:33:31.108868 5667 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:31.112058 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:31.151505 5555 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:31.071133 7947 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:33:31.080556 8364 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.240s user 0.020s sys 0.082s
I20260807 13:33:31.027505 7669 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.148798 5389 catalog_manager.cc:5495] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 3 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:31.081324 8376 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.067099 8252 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:31.186537 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.235212 5667 raft_consensus.cc:2396] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:31.114022 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:31.036520 8373 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.190968 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:31.191561 6637 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:31.236937 5555 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:31.097833 8296 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:31.200587 5389 catalog_manager.cc:5495] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 2 to 3, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.028839 8070 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.224910 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:31.225184 5500 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.099s user 0.015s sys 0.032s
W20260807 13:33:31.247570 5500 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.315s user 0.015s sys 0.033s
I20260807 13:33:31.225669 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:31.197098 8236 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.252281 5620 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:31.253538 8236 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.190466 8417 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.258318 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 104) took 1703 ms. Trace:
I20260807 13:33:31.258853 8417 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.259929 8417 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:31.259083 5656 rpcz_store.cc:276] 0807 13:33:29.554459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.577203 (+ 22744us) service_pool.cc:227] Handling call
0807 13:33:29.588339 (+ 11136us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:30.866399 (+1278060us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:31.239946 (+373547us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000cec54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:31.258242 (+ 18296us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2734100864}
I20260807 13:33:31.235402 8193 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.262320 5554 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:31.262768 8193 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:31.226493 7884 consensus_meta.cc:287] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 0.727s user 0.002s sys 0.011s
I20260807 13:33:31.185976 7947 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:31.263685 8193 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.264755 7947 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:31.087575 8253 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.265563 8253 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:31.267396 5372 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet fc6f41d0f11d4c6295bae40c23631a4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 14f62bf285c448b9b7a21fabd7a5f0bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:31.269194 8253 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:31.066804 8353 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.120s
I20260807 13:33:31.237224 8016 consensus_queue.cc:237] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.272014 8353 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:31.064927 8186 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.232256 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.274875 5659 raft_consensus.cc:2379] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:31.275796 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.277084 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.277128 8186 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.233098 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.279158 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.279637 8345 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:31.279680 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:31.279969 7873 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:31.280826 5767 raft_consensus.cc:2379] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:31.280628 8345 consensus_queue.cc:1046] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260807 13:33:31.237449 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 46010.7us
I20260807 13:33:31.281177 7873 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.197536 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:31.282035 7873 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.264737 7884 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:31.089524 8323 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:31.237860 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:31.285430 5555 raft_consensus.cc:2396] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:31.243888 5389 catalog_manager.cc:5495] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 2 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:31.286430 8323 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:31.239696 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:31.236119 8376 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.287410 5389 catalog_manager.cc:5495] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 2 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.288268 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:31.288823 7817 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:31.077461 8335 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.290418 8376 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.291494 8335 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.292142 5661 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:31.292315 8335 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:31.293392 7884 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.281777 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:31.294219 6680 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:31.294643 5662 raft_consensus.cc:1261] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:31.272853 8353 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:31.295334 5503 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:31.296030 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.296589 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:31.261008 8417 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.283480 7959 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:31.293180 8335 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.327237 8193 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.261827 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.328107 8335 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.329059 8335 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:31.329697 8335 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.332144 8335 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.332942 8335 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:31.287361 5667 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:31.324056 8376 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:31.296738 5659 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:31.289650 7817 raft_consensus.cc:3032] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:31.328589 5656 raft_consensus.cc:2379] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:31.146384 8333 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.297174 5389 catalog_manager.cc:5495] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 4, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 4 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.285800 7873 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:31.184834 8201 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.245540 8368 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:31.317057 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:31.339959 5763 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.539s user 0.031s sys 0.129s
W20260807 13:33:31.305327 8367 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.159s user 0.014s sys 0.030s
W20260807 13:33:31.347395 5552 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.417s user 0.026s sys 0.022s
I20260807 13:33:31.320047 8323 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:31.286454 6688 raft_consensus.cc:1226] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:31.250463 8397 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:31.334637 8341 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.203s user 0.015s sys 0.030s
I20260807 13:33:31.238361 7949 consensus_queue.cc:1035] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
W20260807 13:33:31.385424 5552 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.455s user 0.026s sys 0.025s
W20260807 13:33:31.363700 5763 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.563s user 0.031s sys 0.129s
W20260807 13:33:31.386894 5764 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.443s user 0.000s sys 0.043s
I20260807 13:33:31.234427 8252 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.239284 8346 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
W20260807 13:33:31.397382 5764 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.453s user 0.000s sys 0.043s
W20260807 13:33:31.386525 8367 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.241s user 0.014s sys 0.034s
W20260807 13:33:31.334796 8191 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.350s user 0.025s sys 0.074s
I20260807 13:33:31.338692 7817 raft_consensus.cc:729] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:31.403105 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:31.348100 5389 catalog_manager.cc:5495] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 5, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 5 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.405344 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:31.333750 8335 raft_consensus.cc:686] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:31.407984 8070 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:31.420635 5389 catalog_manager.cc:5495] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 2 to 3, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:33:31.396252 8341 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.275s user 0.016s sys 0.032s
I20260807 13:33:31.441320 8373 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:31.391202 3830 debug-util.cc:398] Leaking SignalData structure 0x7b08003676e0 after lost signal to thread 5766
I20260807 13:33:31.248903 8296 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:31.414626 8368 raft_consensus.cc:686] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
W20260807 13:33:31.402042 8358 consensus_meta.cc:287] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.892s user 0.010s sys 0.007s
I20260807 13:33:31.409915 8252 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:31.397871 5761 consensus_meta.cc:287] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.535s user 0.003s sys 0.009s
I20260807 13:33:31.364720 8193 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:31.453796 5556 raft_consensus.cc:1226] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:31.444422 5389 catalog_manager.cc:5495] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.390643 8323 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:31.467932 5767 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:33:31.501760 5767 pending_rounds.cc:76] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 2
I20260807 13:33:31.414016 8344 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.342199 8376 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:31.452231 5766 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.596s user 0.011s sys 0.065s
W20260807 13:33:31.493755 5618 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.623s user 0.009s sys 0.043s
W20260807 13:33:31.416935 8191 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.433s user 0.025s sys 0.075s
I20260807 13:33:31.502799 5767 pending_rounds.cc:97] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:33:31.453234 8353 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:31.478201 5769 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.293s user 0.036s sys 0.017s
W20260807 13:33:31.453876 8372 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s user 0.005s sys 0.016s
W20260807 13:33:31.511461 5618 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.641s user 0.010s sys 0.043s
I20260807 13:33:31.517081 5767 raft_consensus.cc:2866] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 13:33:31.517560 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 1.64686e+06us
I20260807 13:33:31.518657 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:31.509730 5389 catalog_manager.cc:5495] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:33:31.519630 5769 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.334s user 0.037s sys 0.018s
I20260807 13:33:31.466940 8253 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:31.563405 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 44862us
I20260807 13:33:31.474016 7949 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:31.510690 6636 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.111s user 0.023s sys 0.060s
W20260807 13:33:31.511286 5766 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.655s user 0.012s sys 0.065s
I20260807 13:33:31.451236 7817 consensus_queue.cc:260] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:31.525673 8193 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.648530 8193 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.565279 7669 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:31.527684 8372 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s user 0.005s sys 0.017s
I20260807 13:33:31.510144 5761 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:31.508074 8323 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:31.650403 8288 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077) with higher term. Message: Invalid argument: T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:31.653429 5761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47820 (request call id 116) took 1277 ms. Trace:
I20260807 13:33:31.603842 5767 raft_consensus.cc:1261] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 13:33:31.607648 8436 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.133s user 0.000s sys 0.000s
I20260807 13:33:31.609273 8376 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.524381 7991 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:31.511543 7947 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.576596 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:31.661877 5721 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.181s user 0.035s sys 0.045s
I20260807 13:33:31.576109 8253 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:31.576804 8440 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:31.644573 8353 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.584813 7949 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.522477 5389 catalog_manager.cc:5495] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
W20260807 13:33:31.662242 5721 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.182s user 0.035s sys 0.046s
W20260807 13:33:31.667655 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 1.1872e+06us
W20260807 13:33:31.627386 8347 consensus_meta.cc:287] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 1.103s user 0.011s sys 0.003s
I20260807 13:33:31.477654 8358 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.605695 8371 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:31.606565 8073 consensus_meta.cc:287] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.833s user 0.007s sys 0.005s
W20260807 13:33:31.644032 6636 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.276s user 0.024s sys 0.062s
I20260807 13:33:31.662302 8333 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.655469 8445 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.698773 5389 catalog_manager.cc:5495] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 2, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 2 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:31.709543 5389 catalog_manager.cc:5495] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 2, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 2 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.712235 5389 catalog_manager.cc:5495] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.653920 5761 rpcz_store.cc:276] 0807 13:33:30.376281 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:30.448180 (+ 71899us) service_pool.cc:227] Handling call
0807 13:33:31.653345 (+1205165us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:31.705328 5666 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
W20260807 13:33:31.692711 5658 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.283s user 0.034s sys 0.105s
I20260807 13:33:31.714389 5389 catalog_manager.cc:5495] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:33:31.709539 5765 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.295s user 0.018s sys 0.078s
W20260807 13:33:31.700801 7812 consensus_meta.cc:287] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.016s user 0.011s sys 0.002s
I20260807 13:33:31.700286 8417 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:31.723197 8447 log.cc:924] Time spent T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260807 13:33:31.724520 7947 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.707522 8201 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.725673 6638 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:31.626534 8368 consensus_queue.cc:237] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:31.718627 5658 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.309s user 0.034s sys 0.105s
I20260807 13:33:31.662240 7991 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.728595 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:31.728874 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:31.736539 5616 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.626s user 0.014s sys 0.037s
I20260807 13:33:31.570480 8335 consensus_queue.cc:237] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.730077 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.730125 5389 catalog_manager.cc:5495] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 2 to 3, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.756346 5662 raft_consensus.cc:2354] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:31.756567 5389 catalog_manager.cc:5495] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.758817 5389 catalog_manager.cc:5495] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 2 to 3, leader changed from d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 3 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:31.707062 8376 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.737433 5767 raft_consensus.cc:1261] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:31.741662 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:31.746907 5616 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.879s user 0.015s sys 0.038s
I20260807 13:33:31.697638 8353 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.716321 6680 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:31.781713 5389 catalog_manager.cc:5495] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:31.783888 5389 catalog_manager.cc:5495] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 4, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
W20260807 13:33:31.732010 5765 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.317s user 0.018s sys 0.078s
I20260807 13:33:31.780197 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.736811 8333 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.745548 8417 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:31.746225 7884 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:31.829444 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.831343 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.832810 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:31.833720 5660 raft_consensus.cc:2354] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:31.834573 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.838754 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:31.840011 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.841238 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:31.844297 5503 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:31.845356 8201 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:31.845784 8201 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:31.846467 8201 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:31.846773 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.848124 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.849129 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.842044 5661 raft_consensus.cc:2379] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:31.813848 5721 connection.cc:232] RPC call timeout handler was delayed by -1.0619332869537175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260807 13:33:31.856524 5667 consensus_meta.cc:287] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.522s user 0.010s sys 0.000s
I20260807 13:33:31.856966 5667 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:31.786638 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.719002 8445 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.874202 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.879149 5661 raft_consensus.cc:1226] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:31.881270 5667 raft_consensus.cc:1226] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:31.812932 8372 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.820016 8288 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:31.886260 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:31.889259 5666 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:31.893106 8288 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.894385 8373 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:31.895015 8373 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.895812 8288 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:31.897349 8373 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:31.897696 8070 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260807 13:33:31.902598 7812 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:33:31.827510 8296 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:31.786952 8376 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.907136 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.871454 8353 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.819262 8333 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.884034 7669 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:31.903467 7812 consensus_queue.cc:1046] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:31.826534 8417 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.905732 8430 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:31.917698 8363 consensus_meta.cc:287] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.007s user 0.006s sys 0.007s
I20260807 13:33:31.930966 5660 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:31.910013 8355 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:31.918815 7949 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.891896 8372 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.926954 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.930464 8358 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:31.935189 8253 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:31.958211 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.960367 5662 raft_consensus.cc:2396] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:31.927440 7669 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.963105 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.965817 5659 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:31.965019 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.977322 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:31.937804 8430 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.938251 8355 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:31.954391 5656 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 4.
I20260807 13:33:32.026379 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.027318 5662 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
W20260807 13:33:31.988672 8364 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s user 0.015s sys 0.036s
I20260807 13:33:32.058163 8376 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:32.056061 8364 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s user 0.015s sys 0.037s
I20260807 13:33:32.062445 8371 raft_consensus.cc:3032] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:32.062904 8371 raft_consensus.cc:729] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:32.063696 8371 consensus_queue.cc:260] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:32.068254 5770 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.992s user 0.023s sys 0.063s
W20260807 13:33:32.074465 5770 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.998s user 0.024s sys 0.064s
I20260807 13:33:32.075839 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.076749 5662 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:32.052809 6636 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:32.101336 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.102414 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.128233 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:32.133476 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 109695us
I20260807 13:33:32.124888 8445 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.147599 8355 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.147908 8417 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.148213 8253 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:32.127667 8333 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.153347 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:32.154383 5543 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.154s user 0.030s sys 0.074s
W20260807 13:33:32.154788 5543 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.154s user 0.030s sys 0.074s
I20260807 13:33:32.159106 5666 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:32.161505 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1031) took 2279 ms. Trace:
I20260807 13:33:32.161993 5543 rpcz_store.cc:276] 0807 13:33:29.879599 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.899607 (+ 20008us) service_pool.cc:227] Handling call
0807 13:33:29.899908 (+ 301us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:29.900141 (+ 233us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:33:31.000255 (+1100114us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.158641 (+1158386us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:32.158709 (+ 68us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:32.158763 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.158843 (+ 80us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.158988 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":243298,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":5276,"thread_start_us":2254244,"threads_started":2}
I20260807 13:33:32.146229 8323 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.094909 8201 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.176076 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.160600 8367 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:32.177331 5545 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.089s user 0.031s sys 0.068s
W20260807 13:33:32.181293 5545 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s user 0.031s sys 0.068s
I20260807 13:33:32.182186 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1036) took 1114 ms. Trace:
I20260807 13:33:32.182296 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.182585 5545 rpcz_store.cc:276] 0807 13:33:31.067911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:31.068035 (+ 124us) service_pool.cc:227] Handling call
0807 13:33:31.068328 (+ 293us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:31.068505 (+ 177us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:33:31.087964 (+ 19459us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.181871 (+1093907us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:32.181920 (+ 49us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:32.181957 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.182013 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.182138 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":332285,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":7091,"thread_start_us":1093490,"threads_started":1}
W20260807 13:33:32.160885 8239 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.163s user 0.026s sys 0.031s
W20260807 13:33:32.179781 5725 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.081s user 0.018s sys 0.081s
W20260807 13:33:32.186689 5725 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.088s user 0.018s sys 0.081s
W20260807 13:33:32.187523 5548 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.999s user 0.006s sys 0.022s
W20260807 13:33:32.187858 5548 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s user 0.006s sys 0.022s
W20260807 13:33:32.187064 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 1.08871e+06us
W20260807 13:33:32.189431 5553 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.097s user 0.025s sys 0.050s
W20260807 13:33:32.189723 5553 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.098s user 0.025s sys 0.050s
W20260807 13:33:32.190372 5722 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.065s user 0.000s sys 0.073s
W20260807 13:33:32.190691 5722 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.065s user 0.000s sys 0.073s
W20260807 13:33:32.186498 8239 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.196s user 0.026s sys 0.031s
I20260807 13:33:32.177028 8372 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:32.207818 5501 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.011s user 0.002s sys 0.036s
W20260807 13:33:32.208163 5501 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.011s user 0.002s sys 0.036s
I20260807 13:33:32.161123 8253 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:32.210604 5499 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.064s user 0.017s sys 0.023s
W20260807 13:33:32.210996 5499 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.064s user 0.017s sys 0.023s
W20260807 13:33:32.211752 5621 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.038s user 0.017s sys 0.042s
W20260807 13:33:32.212234 5621 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.038s user 0.018s sys 0.042s
W20260807 13:33:32.218986 5663 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.968s user 0.007s sys 0.019s
W20260807 13:33:32.202821 5722 connection.cc:232] RPC call timeout handler was delayed by -1.0509089091792703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260807 13:33:32.208673 8440 consensus_meta.cc:287] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.544s user 0.011s sys 0.000s
W20260807 13:33:32.239903 5663 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.989s user 0.007s sys 0.019s
W20260807 13:33:32.271051 5500 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.022s user 0.022s sys 0.016s
W20260807 13:33:32.271485 5500 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.022s user 0.022s sys 0.016s
W20260807 13:33:32.272372 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.019s user 0.010s sys 0.028s
W20260807 13:33:32.272734 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.020s user 0.010s sys 0.028s
W20260807 13:33:32.228966 8206 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.031s user 0.016s sys 0.020s
W20260807 13:33:32.274055 8206 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.085s user 0.016s sys 0.021s
W20260807 13:33:32.273051 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 1.02078e+06us
I20260807 13:33:32.210049 8430 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.207249 7991 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:32.211158 7873 consensus_queue.cc:1046] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260807 13:33:32.276217 5722 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.324302 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:33:32.209537 7669 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:32.301846 8364 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:32.218640 8333 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:32.187956 8367 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.274712 8440 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:33:32.302464 8450 log.cc:924] Time spent T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.273s user 0.000s sys 0.001s
I20260807 13:33:32.365137 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.364960 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.366169 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.297763 8403 consensus_queue.cc:1046] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260807 13:33:32.367110 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.368377 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.368984 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.371831 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.415454 5542 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:32.415833 5767 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.415997 5554 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:32.416494 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:32.417147 5542 raft_consensus.cc:2362] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4. Re-sending same reply.
I20260807 13:33:32.417186 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.417994 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.415454 5556 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:33:32.422216 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.423029 5556 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:32.421615 5542 raft_consensus.cc:2362] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4. Re-sending same reply.
I20260807 13:33:32.416867 5545 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:32.425383 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:32.418033 5554 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
W20260807 13:33:32.373629 5372 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet fc6f41d0f11d4c6295bae40c23631a4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 14f62bf285c448b9b7a21fabd7a5f0bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
W20260807 13:33:32.374559 5764 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.881s user 0.003s sys 0.019s
I20260807 13:33:32.298496 8288 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:32.297482 8445 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:32.326633 5763 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.877s user 0.003s sys 0.020s
W20260807 13:33:32.433717 5763 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.985s user 0.003s sys 0.020s
I20260807 13:33:32.390801 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.435961 5544 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:32.323761 8363 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:32.363483 8441 log.cc:924] Time spent T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.283s user 0.000s sys 0.001s
W20260807 13:33:32.396207 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 120123us
I20260807 13:33:32.326292 7884 raft_consensus.cc:686] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:32.373435 7949 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:32.425909 5542 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:32.425971 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:32.449091 5545 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:32.426596 5764 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.933s user 0.003s sys 0.019s
W20260807 13:33:32.426551 5372 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 52976us
I20260807 13:33:32.423919 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:32.317711 5665 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.903s user 0.005s sys 0.025s
W20260807 13:33:32.450464 5665 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.036s user 0.006s sys 0.026s
I20260807 13:33:32.427399 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.376791 8206 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:32.431149 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.432372 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.210256 6636 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:32.433768 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.437745 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:32.400358 8443 log.cc:924] Time spent T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.302s user 0.000s sys 0.001s
W20260807 13:33:32.394954 8191 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s user 0.010s sys 0.016s
I20260807 13:33:32.453485 5659 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:32.391716 8353 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:32.448196 5766 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.802s user 0.037s sys 0.033s
W20260807 13:33:32.318881 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 394989us
W20260807 13:33:32.453794 8454 log.cc:924] Time spent T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.320s user 0.000s sys 0.001s
I20260807 13:33:32.453415 5667 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:32.403431 8333 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.454205 5556 raft_consensus.cc:2396] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:32.489512 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.401058 8501 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:33:32.472944 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 268321us
I20260807 13:33:32.473054 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.472952 8206 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.403206 8070 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:32.478816 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.434981 8201 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:32.451342 5554 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:32.482380 5722 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.484947 5545 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:32.485518 5767 raft_consensus.cc:2379] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:32.511186 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.511348 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:32.469954 8191 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s user 0.011s sys 0.017s
I20260807 13:33:32.486665 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:32.439210 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.401113 8364 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:32.486604 8016 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.156s user 0.064s sys 0.056s
I20260807 13:33:32.494722 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.555064 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.457172 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:32.480217 5766 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.834s user 0.037s sys 0.033s
I20260807 13:33:32.508270 8070 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:32.504490 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.556663 7884 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.559953 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:32.560575 8424 log.cc:924] Time spent T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.480s user 0.003s sys 0.002s
I20260807 13:33:32.441756 8288 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.560695 8364 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:32.554260 8016 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.223s user 0.064s sys 0.057s
I20260807 13:33:32.562223 5766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1374) took 2859 ms. Trace:
I20260807 13:33:32.562361 8288 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:32.510809 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.563818 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.562727 5766 rpcz_store.cc:276] 0807 13:33:29.702979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.746304 (+ 43325us) service_pool.cc:227] Handling call
0807 13:33:29.815804 (+ 69500us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:29.853071 (+ 37267us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:29.853194 (+ 123us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:29.854328 (+ 1134us) log.cc:842] Serialized 26 byte log entry
0807 13:33:31.645449 (+1791121us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:32.561638 (+916189us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.561856 (+ 218us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.561933 (+ 77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:32.561977 (+ 44us) raft_consensus.cc:1671] finished
0807 13:33:32.561992 (+ 15us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.562132 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":74045,"raft.queue_time_us":29128,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":6290,"thread_start_us":2699289,"threads_started":2,"wal-append.queue_time_us":2122670}
I20260807 13:33:32.564460 5554 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.565075 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.565313 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:32.565603 8477 log.cc:924] Time spent T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.159s user 0.001s sys 0.000s
I20260807 13:33:32.566599 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:32.449425 8363 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:32.566895 8451 log.cc:924] Time spent T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.089s user 0.000s sys 0.000s
I20260807 13:33:32.479161 8464 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260807 13:33:32.566731 5763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1370) took 2865 ms. Trace:
I20260807 13:33:32.449294 8445 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.539495 8201 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:32.568935 5554 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:32.539865 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:32.539978 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.569221 5543 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:32.572268 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:32.541114 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 49775.5us
I20260807 13:33:32.470234 7949 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.452832 8467 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260807 13:33:32.474241 8358 consensus_queue.cc:1046] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260807 13:33:32.511808 5767 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.551045 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1026) took 2757 ms. Trace:
I20260807 13:33:32.553426 5662 raft_consensus.cc:1261] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:33:32.553336 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 71170.4us
I20260807 13:33:32.555132 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:32.474810 8323 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:32.404021 8499 consensus_queue.cc:1046] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260807 13:33:32.511925 8501 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:32.557032 5544 raft_consensus.cc:2379] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:32.540215 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:32.505421 8478 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:32.479892 8353 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.566706 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1025) took 2774 ms. Trace:
W20260807 13:33:32.501971 6637 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.626s user 0.000s sys 0.030s
W20260807 13:33:32.626549 6637 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.754s user 0.000s sys 0.031s
I20260807 13:33:32.626634 5618 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:32.569981 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:32.570724 5771 raft_consensus.cc:1226] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:32.564308 7991 raft_consensus.cc:3032] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:32.574702 5769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1096) took 3882 ms. Trace:
I20260807 13:33:32.572613 5542 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:32.588537 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.588922 5764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1376) took 2880 ms. Trace:
I20260807 13:33:32.568405 5763 rpcz_store.cc:276] 0807 13:33:29.701464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.701610 (+ 146us) service_pool.cc:227] Handling call
0807 13:33:29.702154 (+ 544us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:29.747430 (+ 45276us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:29.747470 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:29.747967 (+ 497us) log.cc:842] Serialized 26 byte log entry
0807 13:33:31.396958 (+1648991us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:32.442616 (+1045658us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.442843 (+ 227us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.442929 (+ 86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:32.560046 (+117117us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:32.566406 (+ 6360us) raft_consensus.cc:1671] finished
0807 13:33:32.566533 (+ 127us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.566682 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":41930,"raft.queue_time_us":52971,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":8132,"spinlock_wait_cycles":4169472,"thread_start_us":2582500,"threads_started":2,"wal-append.queue_time_us":2198792}
W20260807 13:33:32.574697 5658 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s user 0.008s sys 0.020s
I20260807 13:33:32.597280 5667 raft_consensus.cc:2396] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:32.570313 8372 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:32.570184 8070 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:32.600342 5389 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s user 0.006s sys 0.017s
W20260807 13:33:32.648085 5389 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.583s user 0.006s sys 0.018s
I20260807 13:33:32.615444 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.598865 5620 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:32.649694 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 50907.2us
I20260807 13:33:32.604931 5770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1379) took 2695 ms. Trace:
W20260807 13:33:32.585971 5721 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.685s user 0.011s sys 0.029s
I20260807 13:33:32.568531 8363 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:32.571483 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:32.593258 5552 rpcz_store.cc:276] 0807 13:33:29.794032 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.850718 (+ 56686us) service_pool.cc:227] Handling call
0807 13:33:29.869925 (+ 19207us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:29.870299 (+ 374us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:29.870327 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:29.886244 (+ 15917us) log.cc:842] Serialized 26 byte log entry
0807 13:33:31.396531 (+1510287us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:33:31.468444 (+ 71913us) log.cc:842] Serialized 14 byte log entry
0807 13:33:31.468724 (+ 280us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:31.468809 (+ 85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:32.550852 (+1082043us) raft_consensus.cc:1671] finished
0807 13:33:32.550874 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.550991 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4308,"prepare.queue_time_us":72832,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":2771,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":16406,"spinlock_wait_cycles":1684352,"thread_start_us":1465623,"threads_started":1,"wal-append.queue_time_us":2079759}
I20260807 13:33:32.574393 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.632087 5554 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:32.629274 5545 raft_consensus.cc:2354] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6.
I20260807 13:33:32.628716 5618 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:32.631757 5722 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:32.641144 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:32.626806 8335 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s user 0.012s sys 0.014s
I20260807 13:33:32.589843 8464 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:32.643337 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:32.644821 5661 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s user 0.012s sys 0.016s
I20260807 13:33:32.629114 5764 rpcz_store.cc:276] 0807 13:33:29.708946 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.713265 (+ 4319us) service_pool.cc:227] Handling call
0807 13:33:29.713655 (+ 390us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:29.908642 (+194987us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:29.908689 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:29.915897 (+ 7208us) log.cc:842] Serialized 52 byte log entry
0807 13:33:31.398352 (+1482455us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:32.449860 (+1051508us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.450194 (+ 334us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.450351 (+ 157us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.450414 (+ 63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:32.566179 (+115765us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b1800136d20. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f3c54ca 00007ff688aa6f99 00007ff68721d088 00007ff6872146b1 00007ff687214657 00007ff687308978 00007ff687308627 00007ff68731cb2c 00007ff68731cad8
0807 13:33:32.588711 (+ 22532us) raft_consensus.cc:1671] finished
0807 13:33:32.588738 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.588867 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":267342,"prepare.queue_time_us":1225942,"raft.queue_time_us":70368,"raft.run_cpu_time_us":3504,"raft.run_wall_time_us":131978,"spinlock_wait_cycles":14549248,"thread_start_us":2410625,"threads_started":2,"wal-append.queue_time_us":2024891}
I20260807 13:33:32.628479 5769 rpcz_store.cc:276] 0807 13:33:28.691895 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:28.710076 (+ 18181us) service_pool.cc:227] Handling call
0807 13:33:28.735295 (+ 25219us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:28.745852 (+ 10557us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:28.745882 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:28.751736 (+ 5854us) log.cc:842] Serialized 26 byte log entry
0807 13:33:30.185484 (+1433748us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b180040c960. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff681ff75bb 00007ff681ffd063 00007ff681ffd411 00007ff68234a5cf
0807 13:33:31.520156 (+1334672us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:31.520207 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:31.520299 (+ 92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:32.569738 (+1049439us) raft_consensus.cc:1671] finished
0807 13:33:32.569756 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.574643 (+ 4887us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3088,"raft.queue_time_us":8035,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":41621,"spinlock_wait_cycles":8108928,"thread_start_us":1334455,"threads_started":1,"wal-append.queue_time_us":3317828}
I20260807 13:33:32.647123 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.556289 8253 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.648839 5767 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:32.621747 8501 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:32.687994 8501 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:32.688199 8482 consensus_queue.cc:1035] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260807 13:33:32.688577 8333 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.689033 5761 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.690483 7949 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:32.690670 8460 log.cc:924] Time spent T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.503s user 0.000s sys 0.003s
I20260807 13:33:32.691408 8206 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:32.658751 8368 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s user 0.014s sys 0.007s
I20260807 13:33:32.672185 5555 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.625517 5548 rpcz_store.cc:276] 0807 13:33:29.792527 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.847575 (+ 55048us) service_pool.cc:227] Handling call
0807 13:33:29.861191 (+ 13616us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:30.080873 (+219682us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:33:31.071238 (+990365us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.188347 (+1117109us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:32.209872 (+ 21525us) log.cc:842] Serialized 26 byte log entry
0807 13:33:32.209997 (+ 125us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:32.210033 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.367130 (+157097us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001a31d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:32.367192 (+ 62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:32.566389 (+199197us) raft_consensus.cc:1671] finished
0807 13:33:32.566505 (+ 116us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.566655 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2258,"prepare.queue_time_us":63240,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":69,"raft.queue_time_us":42232,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":27321,"spinlock_wait_cycles":495649024,"thread_start_us":1986343,"threads_started":2,"wal-append.queue_time_us":1379703}
I20260807 13:33:32.556499 6636 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:32.642277 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:32.636912 5658 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s user 0.009s sys 0.021s
I20260807 13:33:32.580485 8201 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.716877 8201 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:32.650550 5770 rpcz_store.cc:276] 0807 13:33:29.909813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.912447 (+ 2634us) service_pool.cc:227] Handling call
0807 13:33:29.912799 (+ 352us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:29.940857 (+ 28058us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:29.940887 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:29.941343 (+ 456us) log.cc:842] Serialized 26 byte log entry
0807 13:33:32.074954 (+2133611us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:32.595654 (+520700us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.604557 (+ 8903us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.604661 (+ 104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:32.604714 (+ 53us) raft_consensus.cc:1671] finished
0807 13:33:32.604730 (+ 16us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.604870 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":113949,"raft.queue_time_us":39623,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":26765,"thread_start_us":2480223,"threads_started":2,"wal-append.queue_time_us":2438837}
I20260807 13:33:32.718040 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.632539 8428 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:33:32.651544 8459 log.cc:924] Time spent T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.287s user 0.000s sys 0.001s
I20260807 13:33:32.675107 8476 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:32.635833 7991 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:32.682657 8363 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:33:32.677163 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 45462.8us
I20260807 13:33:32.723228 5722 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.675341 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:32.678328 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 200794us
I20260807 13:33:32.724077 5554 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:32.680058 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.681339 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:32.724749 5764 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:32.724874 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:32.676182 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:32.679426 5661 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.625s user 0.012s sys 0.016s
I20260807 13:33:32.679282 5542 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:32.686767 5767 raft_consensus.cc:1226] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:32.687223 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:32.651345 5721 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.750s user 0.011s sys 0.029s
I20260807 13:33:32.636212 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:32.675168 8441 log.cc:924] Time spent T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260807 13:33:32.737161 5552 raft_consensus.cc:2379] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 7: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
W20260807 13:33:32.680595 8335 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s user 0.013s sys 0.015s
I20260807 13:33:32.652251 8073 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:32.709326 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.652065 8323 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:32.634191 8478 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.751726 7991 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.752947 7991 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:32.754142 8478 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.673826 8236 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:32.755347 8239 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:32.755045 8236 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.755777 8239 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:32.756217 8239 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:32.758370 8323 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.761010 8323 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.761235 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.762856 8353 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.735325 8253 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:32.766986 8253 raft_consensus.cc:686] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:32.766827 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:32.651065 8372 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:32.779338 8372 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:32.718848 5548 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:32.780514 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.781524 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:32.782011 5548 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:32.782440 8070 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.784484 8070 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:32.784065 8501 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.785677 6688 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:32.718077 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.787031 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.678237 6680 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:32.719301 8461 log.cc:924] Time spent T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.185s user 0.000s sys 0.000s
I20260807 13:33:32.726724 5499 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:32.725917 5554 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:32.798370 5548 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 6.
I20260807 13:33:32.725943 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:32.714507 8368 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s user 0.017s sys 0.007s
W20260807 13:33:32.736830 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 835979us
I20260807 13:33:32.843226 6680 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:32.843621 5721 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:32.844461 6691 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:32.844904 5721 leader_election.cc:398] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:32.847419 7812 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:32.739288 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.675942 8016 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260807 13:33:32.741344 5722 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:32.849514 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 108236us
I20260807 13:33:32.850181 5722 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.851246 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:32.741895 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.852115 5548 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:32.853338 5767 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:32.698814 8464 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.854524 5556 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:32.855639 8464 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.745481 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.856331 5761 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:32.743355 5766 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.749508 5765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1113) took 3298 ms. Trace:
I20260807 13:33:32.857707 5765 rpcz_store.cc:276] 0807 13:33:29.451470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.452043 (+ 573us) service_pool.cc:227] Handling call
0807 13:33:29.452375 (+ 332us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:29.466998 (+ 14623us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:29.467040 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:29.467538 (+ 498us) log.cc:842] Serialized 26 byte log entry
0807 13:33:30.414820 (+947282us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b180040cea0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff681ff75bb 00007ff681ffd063 00007ff681ffd411 00007ff68234a5cf
0807 13:33:31.785472 (+1370652us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:31.785524 (+ 52us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:31.785609 (+ 85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:32.749220 (+963611us) raft_consensus.cc:1671] finished
0807 13:33:32.749238 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.749454 (+ 216us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22154,"raft.queue_time_us":25694,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":1013,"spinlock_wait_cycles":7806208,"thread_start_us":1370451,"threads_started":1,"wal-append.queue_time_us":2737225}
I20260807 13:33:32.859403 8373 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:32.859781 8373 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:32.860088 8373 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:32.861128 5556 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.862385 5722 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.862500 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.749766 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:32.863224 7873 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:32.750006 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1039) took 1681 ms. Trace:
I20260807 13:33:32.750458 5542 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:32.863517 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.750654 5762 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:32.750713 8445 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:32.751253 8467 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:32.864490 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.865229 5762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1378) took 2958 ms. Trace:
I20260807 13:33:32.865588 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.866339 5542 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:32.867077 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:32.738332 8463 log.cc:924] Time spent T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.247s user 0.000s sys 0.001s
I20260807 13:33:32.737537 8201 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260807 13:33:32.767881 8253 consensus_queue.cc:237] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.863958 5553 rpcz_store.cc:276] 0807 13:33:31.068738 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:31.068842 (+ 104us) service_pool.cc:227] Handling call
0807 13:33:31.081344 (+ 12502us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:32.190047 (+1108703us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:32.190082 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:32.218801 (+ 28719us) log.cc:842] Serialized 26 byte log entry
0807 13:33:32.673671 (+454870us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:32.673704 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.673929 (+ 225us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:32.749826 (+ 75897us) raft_consensus.cc:1671] finished
0807 13:33:32.749844 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.749956 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":170097,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":1372572,"threads_started":2,"wal-append.queue_time_us":465452}
I20260807 13:33:32.869244 5542 raft_consensus.cc:1226] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:32.869772 5553 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260807 13:33:32.870147 5553 pending_rounds.cc:76] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 2
I20260807 13:33:32.870354 5553 pending_rounds.cc:97] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260807 13:33:32.870584 5553 raft_consensus.cc:2866] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:32.770785 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.772056 7817 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:32.773547 5771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1364) took 3718 ms. Trace:
I20260807 13:33:32.873273 5771 rpcz_store.cc:276] 0807 13:33:29.055334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.055499 (+ 165us) service_pool.cc:227] Handling call
0807 13:33:32.570476 (+3514977us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:32.628323 (+ 57847us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.773366 (+145043us) spinlock_profiling.cc:243] Waited 3.51 s on lock 0x7b540029efd0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:32.773490 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8082781952}
I20260807 13:33:32.772776 8367 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:32.776857 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.865586 5762 rpcz_store.cc:276] 0807 13:33:29.909423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:29.909565 (+ 142us) service_pool.cc:227] Handling call
0807 13:33:32.750406 (+2840841us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:32.864522 (+114116us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.865081 (+ 559us) spinlock_profiling.cc:243] Waited 2.82 s on lock 0x7b54002dfd50. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:32.865179 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6482749824}
I20260807 13:33:32.719303 8476 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.797235 5770 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:32.778563 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:32.677507 5763 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.829350 8288 raft_consensus.cc:3032] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
W20260807 13:33:32.814785 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 89629.1us
I20260807 13:33:32.863258 5722 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.806360 6637 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:32.813144 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1409) took 1703 ms. Trace:
I20260807 13:33:32.877383 5722 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.791735 8236 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.804587 8353 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:32.800305 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:32.880169 5555 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:32.881243 5555 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:32.814827 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 103) took 3423 ms. Trace:
I20260807 13:33:32.801097 8455 raft_consensus.cc:3032] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Stepping down as leader of term 5
W20260807 13:33:32.808167 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 131102us
I20260807 13:33:32.889288 5620 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.863873 7873 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:32.803102 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 76457.6us
I20260807 13:33:32.893576 5544 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:32.828716 8371 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:32.815796 8252 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
W20260807 13:33:32.812927 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 184276us
I20260807 13:33:32.808173 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1413) took 1576 ms. Trace:
I20260807 13:33:32.813704 8209 raft_consensus.cc:3032] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:32.813841 8428 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:32.838541 5554 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.886969 7812 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:32.887238 8367 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:32.897909 5663 rpcz_store.cc:276] 0807 13:33:31.231352 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:31.241511 (+ 10159us) service_pool.cc:227] Handling call
0807 13:33:31.241865 (+ 354us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:31.242121 (+ 256us) raft_consensus.cc:1520] Early marking committed up to index 4
0807 13:33:32.243480 (+1001359us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.673228 (+429748us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.807252 (+134024us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b18000582a0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f3c54ca 00007ff688aa6f99 00007ff67f289990 00007ff67f44b864 00007ff67f44b155 00007ff68236e3d0 00007ff682380576 00007ff6823910d7 00007ff682391058
0807 13:33:32.807637 (+ 385us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.807794 (+ 157us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:32.807837 (+ 43us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:32.807874 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.807934 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.808121 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":133604,"prepare.queue_time_us":996180,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":2481,"raft.queue_time_us":134912,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":22943,"spinlock_wait_cycles":4324608,"thread_start_us":1396120,"threads_started":2,"wal-append.queue_time_us":514925}
I20260807 13:33:32.901537 8428 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:32.840487 8372 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.841930 5764 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.905259 5544 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:32.906433 5544 raft_consensus.cc:1226] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:32.907178 8476 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:32.907734 8372 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:32.897632 5548 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:32.908664 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:32.841536 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1061) took 1071 ms. Trace:
I20260807 13:33:32.909837 5548 raft_consensus.cc:1261] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:32.864872 8467 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.767899 6694 raft_consensus.cc:2379] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:32.867205 8345 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 13:33:32.744395 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 235793us
I20260807 13:33:32.845806 5721 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:32.909657 5661 rpcz_store.cc:276] 0807 13:33:31.769754 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:31.880030 (+110276us) service_pool.cc:227] Handling call
0807 13:33:31.880319 (+ 289us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:31.953504 (+ 73185us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:32.737301 (+783797us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.830994 (+ 93693us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:32.831066 (+ 72us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:32.831120 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.839854 (+ 8734us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b180038f200. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:33:32.841303 (+ 1449us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b54002b9dd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:32.841348 (+ 45us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.841480 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39580,"prepare.queue_time_us":424300,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":39719,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":175280256,"thread_start_us":736395,"threads_started":2,"wal-append.queue_time_us":97444}
W20260807 13:33:32.919169 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 73440.3us
I20260807 13:33:32.920111 5721 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:32.875726 5770 raft_consensus.cc:595] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:32.922473 5770 raft_consensus.cc:603] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:32.792076 8191 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:32.877388 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 71109.3us
I20260807 13:33:32.924008 5721 leader_election.cc:398] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5.
I20260807 13:33:32.924203 6637 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:32.884014 5555 raft_consensus.cc:1261] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 13:33:32.878537 5722 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.864231 5556 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:32.877526 5665 rpcz_store.cc:276] 0807 13:33:31.109987 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:31.111679 (+ 1692us) service_pool.cc:227] Handling call
0807 13:33:31.198929 (+ 87250us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:31.389203 (+190274us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:32.451932 (+1062729us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.810353 (+358421us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.810546 (+ 193us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:32.810588 (+ 42us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:32.810623 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.812847 (+ 2224us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54000e56d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:32.812915 (+ 68us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.813071 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":86347,"prepare.queue_time_us":973101,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":87390,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":436956032,"thread_start_us":1308282,"threads_started":2,"wal-append.queue_time_us":347388}
I20260807 13:33:32.887903 6638 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:32.792500 8239 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:32.895771 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:32.897439 8016 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:32.879868 8353 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:32.887091 8363 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:32.882931 8368 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:32.900494 5620 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:32.899577 5618 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:32.896733 8073 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260807 13:33:32.904922 8428 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:32.847642 5503 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:32.687126 8364 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:32.888669 8455 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:32.912209 5548 raft_consensus.cc:1261] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260807 13:33:33.022598 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 175059us
I20260807 13:33:32.899910 8209 raft_consensus.cc:729] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:32.894510 7873 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:32.878765 8288 raft_consensus.cc:729] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:32.930949 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 52472us
I20260807 13:33:32.931686 5721 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:32.939091 5499 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:33.030026 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 98414.7us
W20260807 13:33:33.030243 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 91258.7us
I20260807 13:33:33.029801 5722 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:32.959592 8363 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:32.940521 8501 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:32.940500 8201 raft_consensus.cc:2741] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 13:33:32.956874 8467 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:32.957284 8353 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:32.903159 7812 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:32.962466 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 86518.2us
W20260807 13:33:33.010993 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 111482us
W20260807 13:33:33.009658 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 109234us
I20260807 13:33:32.918401 8345 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:32.933986 8358 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:32.929147 7991 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:32.914238 5554 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:33.054061 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:32.933097 7884 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:32.937443 8070 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:33.072734 8070 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:33.073158 8070 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:32.901684 8252 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:32.935642 8498 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:33.029129 8445 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:33.025451 8364 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.013383 8376 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:33.035327 5665 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:33.036183 5721 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:33.082847 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 46714.9us
I20260807 13:33:33.038930 5548 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:38210
I20260807 13:33:33.016641 8473 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:33.046746 5620 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:32.935002 8191 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.048120 5618 leader_election.cc:398] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6.
I20260807 13:33:32.939972 8372 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260807 13:33:33.037307 8464 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:32.933648 8016 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:33.070988 5556 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:33.054328 8345 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:33.034633 8500 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:33:33.075446 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 45759.5us
I20260807 13:33:33.035487 8239 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:32.916111 8367 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.101114 8367 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.038364 8363 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.105408 8345 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.075004 8455 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:33.084997 5620 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.079370 8288 consensus_queue.cc:260] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.086402 8073 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:33.071100 8209 consensus_queue.cc:260] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.087100 7991 consensus_queue.cc:1046] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:33.046958 8466 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:33.046195 7812 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:33.089303 5618 leader_election.cc:401] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:33.094503 5721 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.119272 8209 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:33.119580 5721 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.118042 8073 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:33.122684 8372 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:33.123106 8073 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.123168 8372 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:33.123668 8372 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.123525 7873 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.124769 7991 raft_consensus.cc:3032] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:33.125181 7991 raft_consensus.cc:729] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:33.125491 7873 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:33.126371 8239 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 13:33:33.128677 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 43807.6us
I20260807 13:33:33.110212 8345 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:33.110014 8542 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:33:33.088454 8358 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:33:33.128710 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 82438.3us
I20260807 13:33:33.083804 5548 raft_consensus.cc:595] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:33.136051 5548 raft_consensus.cc:603] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:33.137197 5618 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:33.126470 7991 consensus_queue.cc:260] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.129524 5620 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.094233 8445 raft_consensus.cc:686] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:33.133752 5545 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:33.099884 5722 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:33.138697 5721 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.138923 5618 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:33.130136 8355 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 6
I20260807 13:33:33.173049 7884 raft_consensus.cc:686] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:33.174191 7884 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:33.111555 8288 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:33.144059 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:33.111640 8016 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:33.187398 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 57920.9us
I20260807 13:33:33.098277 8473 raft_consensus.cc:686] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:33.192318 5620 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:33.192535 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 92715.9us
W20260807 13:33:33.192878 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 54250.7us
I20260807 13:33:33.193172 5722 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:33.134672 8376 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:33.194023 5721 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:33.199052 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 60229.5us
I20260807 13:33:33.200937 5618 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:33.130486 8464 raft_consensus.cc:686] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:33.127388 8466 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:33.171424 8417 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:33.191784 8367 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:33.195855 8482 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:33.210131 5722 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:33.208673 8524 log.cc:924] Time spent T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.130s user 0.000s sys 0.000s
I20260807 13:33:33.202302 8376 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:32.886861 5658 rpcz_store.cc:276] 0807 13:33:29.391610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:30.378613 (+987003us) service_pool.cc:227] Handling call
0807 13:33:30.409169 (+ 30556us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:30.409579 (+ 410us) raft_consensus.cc:1520] Early marking committed up to index 7
0807 13:33:31.767215 (+1357636us) log.cc:842] Serialized 14 byte log entry
0807 13:33:32.814363 (+1047148us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:32.814457 (+ 94us) raft_consensus.cc:1631] Marking committed up to 7
0807 13:33:32.814515 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:32.814613 (+ 98us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:32.814758 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":99174,"prepare.queue_time_us":1779970,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":1946,"raft.queue_time_us":99342,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":2257540,"threads_started":2,"wal-append.queue_time_us":942973}
I20260807 13:33:33.205865 8500 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:33.206058 8358 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:33.205250 8466 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:33.220937 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 149566us
I20260807 13:33:33.212484 7991 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:33.135752 8498 consensus_queue.cc:1046] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260807 13:33:33.232721 5548 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 13:33:33.210145 8417 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:33.215761 8239 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:33.213565 8367 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:33.217114 8333 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:33.218863 8430 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:33.253074 8355 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6.
W20260807 13:33:33.255939 8535 log.cc:924] Time spent T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.187s user 0.003s sys 0.000s
I20260807 13:33:33.227926 8376 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:33.227774 8482 raft_consensus.cc:686] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:33.272456 8529 log.cc:924] Time spent T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.066s user 0.000s sys 0.000s
I20260807 13:33:33.247364 8239 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:33.275029 8239 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:33.264535 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 63659.6us
I20260807 13:33:33.276046 8353 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.230675 8358 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:33.243376 8364 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.284794 8252 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:33.244782 8417 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:33.276836 8371 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:33.288141 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:33.267988 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 74026.1us
I20260807 13:33:33.276907 8464 consensus_queue.cc:237] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:33.278487 5618 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:33.248955 8500 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:33.259709 8367 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:33.267921 8473 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:33.290335 5721 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.263082 8333 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:33.294672 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 84608.6us
I20260807 13:33:33.295508 8016 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:33.296567 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 104325us
W20260807 13:33:33.270421 8522 log.cc:924] Time spent T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Append to log took a long time: real 0.429s user 0.000s sys 0.003s
I20260807 13:33:33.298552 8191 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.309058 5618 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:33.298919 8353 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.298985 8371 raft_consensus.cc:686] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:33.270267 8430 raft_consensus.cc:686] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:33.302767 5721 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.303129 8355 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:33.258750 8253 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260807 13:33:33.242709 8445 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:33.299786 5658 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 13:33:33.314633 5618 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:33.304663 5722 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:33.300781 8500 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:33.305699 8333 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:33.319080 5722 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:33.284818 8358 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.315146 5721 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:33.306813 7873 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:33.316063 8345 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:33.315623 8252 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:33.323002 7817 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:33.319402 8500 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.322544 8073 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.344604 7817 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:33.345074 7817 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:33.346408 8467 raft_consensus.cc:3032] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:33.346494 8073 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.346895 8467 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:33.344259 8355 consensus_queue.cc:1046] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:33.347690 8467 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:33.321947 8550 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260807 13:33:33.323796 8482 consensus_queue.cc:237] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.354434 8537 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:33.354815 8252 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:33.338340 8547 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:33.356418 7817 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.407289 8547 raft_consensus.cc:686] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:33.323755 7873 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:33.408125 7873 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:33.408245 8547 consensus_queue.cc:237] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.403687 8554 raft_consensus.cc:3032] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
W20260807 13:33:33.404309 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 93658.6us
I20260807 13:33:33.314079 8440 consensus_queue.cc:1046] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260807 13:33:33.311849 8363 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.404440 8252 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:33.320165 8551 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:33.418378 5620 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:33.435089 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 114464us
I20260807 13:33:33.437306 5665 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 6.
W20260807 13:33:33.421243 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 99407us
I20260807 13:33:33.317863 8548 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.096s
I20260807 13:33:33.401823 8353 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:33.460800 8367 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.405663 8537 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:33.470250 5770 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9417f147a78e41728d00594b19828f18"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:33.470849 5770 raft_consensus.cc:595] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.474252 8552 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:33.434391 8430 consensus_queue.cc:237] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.474527 8363 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:33.475821 7817 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:33.423029 8428 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.478978 8428 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.478892 8466 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.466271 8467 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:33.481112 8466 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:33.470278 8537 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.483327 5658 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260807 13:33:33.464180 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 149074us
W20260807 13:33:33.465907 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 47625.1us
I20260807 13:33:33.416851 8554 raft_consensus.cc:729] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:33.467542 5764 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 13:33:33.379766 8345 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:33.466566 5722 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:33.410094 8417 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.510865 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:33.512914 5544 raft_consensus.cc:1261] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:33.514487 5548 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:33.515763 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:33.517282 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:33.518088 5552 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:33.520100 5554 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:33.521936 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.522902 5542 raft_consensus.cc:2379] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:33.526053 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.527880 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.528618 5542 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:33.530659 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:33.534567 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.535315 5545 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:33.544688 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.552537 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.555250 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.555959 5548 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:33.462430 8551 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:33.430680 8253 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260807 13:33:33.566915 8562 log.cc:924] Time spent T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.171s user 0.001s sys 0.000s
I20260807 13:33:33.582039 5769 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260807 13:33:33.588656 5769 pending_rounds.cc:76] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 5
I20260807 13:33:33.588954 5769 pending_rounds.cc:97] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260807 13:33:33.589202 5769 raft_consensus.cc:2866] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:33.592846 5542 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:33.416945 8371 consensus_queue.cc:237] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.568790 7817 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:33.587162 5545 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:33.595669 5722 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.598060 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.571633 8550 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:33.605140 5545 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:38210
I20260807 13:33:33.485160 8353 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.614359 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.615442 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.618746 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.619554 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:33.572146 8551 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:33.611557 5545 raft_consensus.cc:595] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:33.579246 8016 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.623289 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.631405 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.632628 5545 raft_consensus.cc:603] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 13:33:33.621923 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 135646us
I20260807 13:33:33.616226 5765 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:33.633225 5722 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:33.629485 5548 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
W20260807 13:33:33.600570 8373 consensus_meta.cc:287] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.740s user 0.009s sys 0.001s
I20260807 13:33:33.638877 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:33.609179 8070 consensus_meta.cc:287] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.536s user 0.018s sys 0.005s
I20260807 13:33:33.640128 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.637602 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.643560 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.603641 7817 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:33.644021 5770 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:33.570611 8239 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.645468 5620 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.646934 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.647578 8353 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.647378 8070 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.648069 8549 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:33.580480 8073 consensus_queue.cc:1046] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260807 13:33:33.600020 8501 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260807 13:33:33.657155 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.657768 5762 raft_consensus.cc:2379] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:33.621338 8363 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:33.663949 5620 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.664175 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:33.658164 8549 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:33.701071 5767 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.668555 8455 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:33.703375 5763 raft_consensus.cc:2379] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:33.677886 7873 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.676383 5556 raft_consensus.cc:1226] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260807 13:33:33.679248 8345 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:33.655261 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.707355 5761 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:33.708344 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.709024 5761 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:33.588117 8553 consensus_queue.cc:1046] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260807 13:33:33.683580 8500 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.709087 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.686820 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.713618 5765 raft_consensus.cc:2379] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:33.714440 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.691103 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:33.715401 7873 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:33.698160 5770 raft_consensus.cc:2379] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:33.717677 5770 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:33.667343 8070 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:33.712656 8500 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:33.630964 8544 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260807 13:33:33.710000 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.723021 5761 raft_consensus.cc:2379] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:33.715468 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.728890 5761 raft_consensus.cc:1261] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:33.699678 8430 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:33.699702 8073 consensus_queue.cc:1225] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260807 13:33:33.735154 8557 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:33.735641 8560 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:33:33.735786 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 71955.6us
I20260807 13:33:33.651111 7817 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:33.746361 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 47451.8us
I20260807 13:33:33.757226 5764 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:33.757092 5722 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:33.772222 5620 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:33.773276 5620 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:33.774718 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 323845us
I20260807 13:33:33.774780 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:33.772955 5722 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:33.735102 8430 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:33.776377 5767 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:33.781876 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:33.784700 5501 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.195:43427 timed out after 1.503s (SENT) [suppressed 11 similar messages]
I20260807 13:33:33.636377 8558 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.141s
I20260807 13:33:33.786458 5618 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:33.736364 8549 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.736088 8560 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:33.787276 5722 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:33.789510 5499 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:33.644626 8373 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:33.772835 8288 consensus_meta.cc:287] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.577s user 0.007s sys 0.003s
I20260807 13:33:33.790697 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.645320 8570 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.145s
I20260807 13:33:33.776259 8498 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260807 13:33:33.860282 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 65009us
I20260807 13:33:33.778914 8335 raft_consensus.cc:3032] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:33.787133 8430 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:33.861761 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 74551.5us
I20260807 13:33:33.735792 8557 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:33.636631 8554 consensus_queue.cc:260] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.788842 8367 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.863483 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.971009 5769 raft_consensus.cc:2396] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260807 13:33:33.945983 5556 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 13:33:33.962040 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:33.972375 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:33.941980 5763 raft_consensus.cc:2396] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:33.966810 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.973928 5545 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.968436 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.969323 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:33.790066 8552 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:33.781821 8070 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:33.972906 5767 raft_consensus.cc:2362] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5. Re-sending same reply.
I20260807 13:33:33.978744 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:33.959173 8372 consensus_meta.cc:287] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.835s user 0.011s sys 0.000s
W20260807 13:33:33.873193 8358 consensus_meta.cc:287] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.531s user 0.004s sys 0.004s
I20260807 13:33:34.032075 5770 raft_consensus.cc:595] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:34.039227 5770 raft_consensus.cc:603] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:33.794904 8473 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:33.783856 8578 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:33.989796 5545 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:34.051857 8578 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:34.052245 8578 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:34.052289 8209 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:33.857319 8445 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:33.797641 8560 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:34.054080 5722 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:34.058576 7873 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:34.059240 7873 raft_consensus.cc:686] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:34.060281 7873 consensus_queue.cc:237] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:33.864431 8239 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:33.874519 8572 raft_consensus.cc:3032] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:34.054330 8445 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:34.062589 8572 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:34.062883 8445 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:33.867233 8335 raft_consensus.cc:729] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:33.797580 8550 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:33.874145 8570 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:33.943570 8417 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:33.873584 8547 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:33.876526 8333 consensus_meta.cc:287] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.537s user 0.007s sys 0.000s
I20260807 13:33:33.859259 8553 consensus_queue.cc:1035] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.185s
I20260807 13:33:34.048897 8500 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.034147 8355 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260807 13:33:34.049435 8070 raft_consensus.cc:686] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:33.793932 8482 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.241s
I20260807 13:33:34.051352 8373 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:34.037209 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.066709 5543 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:34.073622 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.074048 5556 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260807 13:33:33.958684 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 161114us
I20260807 13:33:34.096169 8547 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:34.122747 6636 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:34.125269 8547 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:34.032965 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.126338 7884 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:34.126859 7884 raft_consensus.cc:686] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:33.965058 8537 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.127988 5771 raft_consensus.cc:2379] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.127681 7884 consensus_queue.cc:237] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:34.129046 8537 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:33.970885 8440 consensus_queue.cc:1159] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "737c581af06a42df94970a1542600159" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260807 13:33:34.078639 7991 consensus_meta.cc:287] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.829s user 0.010s sys 0.000s
I20260807 13:33:34.045849 8473 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:34.130967 8473 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:34.055876 8552 raft_consensus.cc:686] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:34.034359 8253 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260807 13:33:34.137451 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.140635 5767 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:34.141517 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:34.142072 5767 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:34.105890 5548 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:34.106472 7812 consensus_meta.cc:287] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.969s user 0.008s sys 0.002s
I20260807 13:33:34.120555 8070 consensus_queue.cc:237] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.099596 8500 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.094947 8333 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.134678 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.046195 8358 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.136013 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.170991 5556 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:34.169775 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.173803 5769 raft_consensus.cc:2379] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.156744 5548 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:34.093840 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.046073 8372 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.063545 8572 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.095504 8570 raft_consensus.cc:686] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:34.106298 8376 consensus_meta.cc:287] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.823s user 0.008s sys 0.001s
I20260807 13:33:34.168291 5767 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:34.129794 8537 consensus_queue.cc:1046] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260807 13:33:34.178346 5722 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:34.177776 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 316759us
W20260807 13:33:34.183853 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 214254us
I20260807 13:33:34.186817 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.190953 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.191640 5767 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:34.192613 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.193492 5767 raft_consensus.cc:2379] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.206947 5556 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:34.207003 5618 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:34.197441 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.208470 5767 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:34.209022 5722 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:34.209229 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.210258 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:34.187275 8591 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.092s user 0.000s sys 0.001s
I20260807 13:33:34.215430 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.239027 5663 raft_consensus.cc:2396] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:34.240053 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.240727 5663 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:34.241580 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.244127 5667 raft_consensus.cc:1226] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:34.244498 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:34.245340 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.244136 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:34.218207 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.219296 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.251873 5660 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:34.235986 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.164551 7812 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.253978 5554 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:34.252398 5663 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:34.105764 8335 consensus_queue.cc:260] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.282627 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:34.258141 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.283959 5767 raft_consensus.cc:2362] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5. Re-sending same reply.
I20260807 13:33:34.284956 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.285542 5767 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:34.252060 5659 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:34.259157 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.259725 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.260002 5552 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260807 13:33:34.259934 8500 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:34.260529 8579 log.cc:924] Time spent T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.092s user 0.000s sys 0.000s
I20260807 13:33:34.260715 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.260823 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.261807 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.262763 5556 raft_consensus.cc:1261] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:34.264760 8547 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:34.266032 6685 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 13:33:34.179939 8549 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.270337 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.236728 8552 consensus_queue.cc:237] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.195266 8376 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:34.272459 8596 log.cc:924] Time spent T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.068s user 0.000s sys 0.001s
I20260807 13:33:34.273833 8372 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:34.274618 8557 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:34.179739 7991 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
W20260807 13:33:34.276113 8551 consensus_meta.cc:287] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.635s user 0.008s sys 0.000s
I20260807 13:33:34.279230 8333 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.243906 8371 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:34.295809 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.297039 5553 raft_consensus.cc:2354] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:34.279733 8570 consensus_queue.cc:237] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.297834 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:34.243692 8373 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:34.301640 5762 raft_consensus.cc:2379] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.303452 5556 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260807 13:33:34.271219 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 58523.3us
I20260807 13:33:34.327406 8473 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.381475 5765 raft_consensus.cc:2379] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.300694 8547 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:34.386658 5667 raft_consensus.cc:1226] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:34.430750 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:34.437007 5372 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet fc6f41d0f11d4c6295bae40c23631a4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260807 13:33:34.342875 5548 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:34.435845 5764 raft_consensus.cc:1226] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:34.461462 5764 raft_consensus.cc:1226] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260807 13:33:34.441448 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.302240 8500 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.455211 5554 raft_consensus.cc:2379] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:34.472646 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.473901 5659 raft_consensus.cc:2396] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:34.318256 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:34.477540 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 270165us
I20260807 13:33:34.426672 8428 raft_consensus.cc:3032] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:34.382110 8537 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.469182 8547 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:34.481467 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.382294 8358 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:34.394868 8376 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.427338 8363 raft_consensus.cc:3032] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:34.435405 8430 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.484694 5660 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:34.471773 8482 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.477368 8371 raft_consensus.cc:686] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:34.455679 8445 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.499508 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.501591 5552 raft_consensus.cc:1226] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:33:34.501734 5660 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:34.480891 8428 raft_consensus.cc:729] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:34.441299 8353 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260807 13:33:34.431965 8560 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.494762 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.469185 8551 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.491904 8363 raft_consensus.cc:729] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:34.486300 8373 raft_consensus.cc:686] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:34.474506 8500 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.515317 5542 raft_consensus.cc:2379] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:34.503998 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.499548 8430 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.529958 5767 raft_consensus.cc:1226] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260807 13:33:34.542264 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.542577 5658 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:33:34.543052 5552 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:34.487251 8537 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.549291 5658 raft_consensus.cc:1226] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260807 13:33:34.515707 7812 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:34.558887 5499 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:34.522275 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.500780 8482 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.541990 8333 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:34.556845 8621 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:34.560544 8367 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.564800 8549 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:34.591974 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:34.568156 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:34.601961 5499 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:34.597308 5761 raft_consensus.cc:2379] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.609221 5660 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:34.590611 8473 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.589097 8353 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:34.631088 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 59896.7us
I20260807 13:33:34.556887 8428 consensus_queue.cc:260] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.637633 8637 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:34.640524 8641 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:34.605391 8607 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.655467 8551 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:34.655251 8607 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:34.656939 8482 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.622519 6685 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:34.657935 8560 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.658047 8607 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:34.641975 5552 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:34.658697 8537 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:34.659454 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:34.660491 8252 consensus_meta.cc:287] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.196s user 0.006s sys 0.006s
I20260807 13:33:34.660882 8252 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.600689 8635 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:34.587927 8333 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.573899 8371 consensus_queue.cc:237] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.650638 5618 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:34.674049 5618 leader_election.cc:398] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:34.650507 8643 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 13:33:34.652667 8613 log.cc:924] Time spent T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.130s user 0.000s sys 0.000s
W20260807 13:33:34.653131 8616 log.cc:924] Time spent T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.101s user 0.000s sys 0.000s
W20260807 13:33:34.653901 8631 log.cc:924] Time spent T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260807 13:33:34.654412 8445 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.654522 8641 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:34.679838 8641 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:34.657867 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.682339 6680 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:33:34.682520 5764 raft_consensus.cc:2379] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.683529 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.685065 5764 raft_consensus.cc:1226] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:34.659682 8500 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:34.687040 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.687570 5542 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:34.688849 8333 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:34.652684 8619 log.cc:924] Time spent T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
I20260807 13:33:34.691370 5762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1408) took 1034 ms. Trace:
I20260807 13:33:34.691823 5762 rpcz_store.cc:276] 0807 13:33:33.657029 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:33.737613 (+ 80584us) service_pool.cc:227] Handling call
0807 13:33:34.691157 (+953544us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54001f0c54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:34.691301 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1188416896}
I20260807 13:33:34.661018 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.645057 5499 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:33:34.632885 8578 consensus_meta.cc:287] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.580s user 0.011s sys 0.000s
I20260807 13:33:34.650364 8639 consensus_queue.cc:1035] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:34.667654 5722 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:34.592144 8373 consensus_queue.cc:237] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.669401 8252 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:34.670217 8620 log.cc:924] Time spent T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.076s user 0.001s sys 0.000s
W20260807 13:33:34.670351 7817 consensus_meta.cc:287] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.892s user 0.011s sys 0.000s
I20260807 13:33:34.586799 8363 consensus_queue.cc:260] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.642056 8417 consensus_queue.cc:1046] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260807 13:33:34.674552 5618 leader_election.cc:401] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260807 13:33:34.631635 8549 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.675825 8430 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:34.602177 8367 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.672122 8635 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:34.697664 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 52709us
I20260807 13:33:34.598259 8621 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.647521 8353 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.706336 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:34.722249 8549 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:34.722682 6685 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:34.723097 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.711903 8551 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:34.723932 8551 raft_consensus.cc:686] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:34.724179 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:34.724341 8549 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:34.724761 8551 consensus_queue.cc:237] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.725422 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.725580 8430 raft_consensus.cc:686] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:34.725991 5545 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:34.712153 8368 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:34.726492 5503 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:34.726658 8368 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:34.695708 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:34.711784 8609 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:34.728044 8621 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.728262 8417 raft_consensus.cc:3032] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:34.729128 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.730345 8367 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.731925 5499 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:33:34.733161 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 59252.2us
I20260807 13:33:34.734997 8353 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:34.705003 8578 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.735486 8635 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:34.726532 8430 consensus_queue.cc:237] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.704473 8070 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.736578 7817 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.707685 8641 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.738348 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 903) took 1668 ms. Trace:
I20260807 13:33:34.773837 5499 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:34.724776 5553 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:34.704893 5542 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:34.775058 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.775305 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:34.751111 5501 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:34.752115 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:34.776683 5552 raft_consensus.cc:2379] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:34.754031 8417 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:34.718657 8572 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:34.749758 8445 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.735814 8252 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:34.767297 5545 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:34.796838 5545 raft_consensus.cc:1261] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260807 13:33:34.797267 5545 pending_rounds.cc:76] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 2
I20260807 13:33:34.797528 5545 pending_rounds.cc:97] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260807 13:33:34.797802 5545 raft_consensus.cc:2866] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:34.798947 5663 raft_consensus.cc:1226] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:34.769359 5762 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:34.752802 8637 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:34.750813 8609 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:34.773949 5555 rpcz_store.cc:276] 0807 13:33:33.070441 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:33.070738 (+ 297us) service_pool.cc:227] Handling call
0807 13:33:34.737659 (+1666921us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003976d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:34.738276 (+ 617us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2355020672}
I20260807 13:33:34.711077 5656 raft_consensus.cc:1226] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:34.783026 5553 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 13:33:34.812502 5769 raft_consensus.cc:2379] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.812875 5553 raft_consensus.cc:1261] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:33:34.785423 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.774703 5761 raft_consensus.cc:2379] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.792815 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.818930 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.820318 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.793586 8640 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
W20260807 13:33:34.802830 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 95847.8us
I20260807 13:33:34.803723 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.809628 5545 raft_consensus.cc:1226] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260807 13:33:34.824290 5661 raft_consensus.cc:2379] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:34.810945 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.804409 8637 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:34.817448 5553 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:34.776226 8607 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:34.821378 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:34.822705 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.804847 8464 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:34.825953 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.832511 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.833113 5665 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:34.815231 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.811375 8609 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:34.829177 5658 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:34.830209 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.798462 8643 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260807 13:33:34.798317 8367 consensus_queue.cc:1046] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260807 13:33:34.786999 8353 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260807 13:33:34.781852 8070 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.841619 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.833913 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.807547 8445 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.811728 8642 consensus_queue.cc:1046] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260807 13:33:34.841904 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.982911 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.859601 8288 raft_consensus.cc:979] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: : Instructing follower 14f62bf285c448b9b7a21fabd7a5f0bf to start an election
I20260807 13:33:34.984459 8570 raft_consensus.cc:1067] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Signalling peer 14f62bf285c448b9b7a21fabd7a5f0bf to start an election
W20260807 13:33:34.984789 8650 log.cc:924] Time spent T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.145s user 0.021s sys 0.027s
I20260807 13:33:34.985955 8642 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:34.831596 8417 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:34.987156 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.988291 5665 raft_consensus.cc:2379] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:34.832063 8637 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:34.988998 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.897126 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.989944 5656 raft_consensus.cc:2379] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:34.991277 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:34.992764 5762 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:34.993968 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:34.994846 5762 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:34.996491 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:34.997359 5661 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:34.831007 8607 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:35.004724 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:35.005015 5661 raft_consensus.cc:1226] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:35.006181 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:35.005359 5658 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:35.028868 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.029377 5656 raft_consensus.cc:1226] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:35.031030 5542 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:35.031409 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.030634 5656 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:35.032330 5762 raft_consensus.cc:2379] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:34.986449 8642 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.007067 8607 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:35.039433 7817 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:35.031859 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:34.940793 8464 consensus_queue.cc:1046] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260807 13:33:35.062378 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.053552 8578 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.053689 8368 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.056386 8641 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:35.074719 8648 log.cc:924] Time spent T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.288s user 0.001s sys 0.001s
I20260807 13:33:35.085875 5770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43388 (request call id 6) took 1387 ms. Trace:
I20260807 13:33:35.069064 8353 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:35.090950 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.075623 5761 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:35.083627 8547 consensus_meta.cc:287] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.590s user 0.009s sys 0.002s
I20260807 13:33:35.117277 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:35.111246 8641 raft_consensus.cc:3032] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:35.071568 8640 raft_consensus.cc:686] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:35.118045 8353 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:35.120337 8445 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.122373 8642 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.114734 5770 rpcz_store.cc:276] 0807 13:33:33.695490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:33.717511 (+ 22021us) service_pool.cc:227] Handling call
0807 13:33:35.082604 (+1365093us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400265f54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682370bc3 00007ff6872ba81a 00007ff6809add04 00007ff6809adc92 00007ff6809adbc1 00007ff6809adb3c 00007ff6809acdf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:35.082729 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":721565952}
W20260807 13:33:35.130717 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 293687us
W20260807 13:33:35.090276 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 266541us
I20260807 13:33:35.080670 8070 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:35.081000 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 255494us
I20260807 13:33:35.097492 8653 raft_consensus.cc:3032] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:35.224076 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.225086 5770 raft_consensus.cc:2379] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:35.218962 5761 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:35.227399 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.160162 8641 raft_consensus.cc:729] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:35.230171 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:35.242494 5656 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:35.162621 8547 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.289485 5656 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:35.291145 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:35.291860 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 129634us
I20260807 13:33:35.294780 5761 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:35.295282 5501 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.296169 5762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1152) took 1316 ms. Trace:
I20260807 13:33:35.300285 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.304858 5501 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.308632 5761 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:35.309465 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.309809 5659 raft_consensus.cc:2379] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:35.292282 8653 raft_consensus.cc:729] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:35.310318 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.289812 8609 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.311759 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.313547 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.315032 5770 raft_consensus.cc:2379] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:35.314947 5761 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:35.315979 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.317416 5761 raft_consensus.cc:2354] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:35.321024 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.323962 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.324618 8609 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.308902 8641 consensus_queue.cc:260] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.325346 5770 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 13:33:35.326512 8653 consensus_queue.cc:260] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.324631 5761 raft_consensus.cc:1226] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:33:35.325892 5770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1433) took 1070 ms. Trace:
I20260807 13:33:35.330796 5770 rpcz_store.cc:276] 0807 13:33:34.255473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:35.324800 (+1069327us) service_pool.cc:227] Handling call
0807 13:33:35.325067 (+ 267us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:35.325664 (+ 597us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:35.325844 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:35.332402 5761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1154) took 1283 ms. Trace:
I20260807 13:33:35.333124 5761 rpcz_store.cc:276] 0807 13:33:34.049226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:35.324024 (+1274798us) service_pool.cc:227] Handling call
0807 13:33:35.324324 (+ 300us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:35.332098 (+ 7774us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:35.332330 (+ 232us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:35.303910 8640 consensus_queue.cc:237] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.318737 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:35.356662 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.366164 5761 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:35.358618 5770 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 13:33:35.316922 8664 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:35.361052 8353 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:35.363334 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:35.347820 8653 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:35.365211 8674 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:35.448431 5761 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:35.449589 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:35.458835 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 154044us
I20260807 13:33:35.460700 5501 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:35.448285 8635 consensus_meta.cc:287] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.667s user 0.008s sys 0.018s
I20260807 13:33:35.462934 5501 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:35.475596 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.476878 5501 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:35.474772 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:35.483291 5501 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:35.484278 8673 log.cc:924] Time spent T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.074s user 0.000s sys 0.001s
I20260807 13:33:35.479151 8547 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.478511 8612 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:35.488942 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.490406 5501 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.492085 5501 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:35.467197 8635 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.486824 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:35.496536 8675 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:35.496731 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:35.496927 8675 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:35.497424 8675 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:35.496732 5763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1409) took 1837 ms (client timeout 2391 ms). Trace:
W20260807 13:33:35.501593 5763 rpcz_store.cc:269] 0807 13:33:33.659608 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:33.707470 (+ 47862us) service_pool.cc:227] Handling call
0807 13:33:35.496527 (+1789057us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540008f554. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:35.496670 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":524383616}
I20260807 13:33:35.501775 5767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1402) took 1867 ms. Trace:
I20260807 13:33:35.502863 5767 rpcz_store.cc:276] 0807 13:33:33.634292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.456739 (+822447us) service_pool.cc:227] Handling call
0807 13:33:34.457109 (+ 370us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:34.530366 (+ 73257us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:35.501553 (+971187us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b54001f0754. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:35.501725 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":164633856}
I20260807 13:33:35.504006 5767 raft_consensus.cc:1226] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
W20260807 13:33:35.504917 5372 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet fc6f41d0f11d4c6295bae40c23631a4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260807 13:33:35.505165 5501 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.506265 5763 raft_consensus.cc:1226] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260807 13:33:35.507416 5763 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:35.487589 8667 raft_consensus.cc:2741] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 13:33:35.517827 5765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1405) took 1875 ms. Trace:
I20260807 13:33:35.518482 8667 consensus_queue.cc:1046] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:35.518282 5765 rpcz_store.cc:276] 0807 13:33:33.642340 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:33.715247 (+ 72907us) service_pool.cc:227] Handling call
0807 13:33:35.517638 (+1802391us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b540020bcd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:35.517771 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1492898688}
I20260807 13:33:35.519719 8667 consensus_queue.cc:1046] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:35.520535 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.505535 8642 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:35.521320 5765 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:35.485894 8677 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:35.517484 8612 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:35.522694 5767 raft_consensus.cc:1226] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:35.522745 5763 raft_consensus.cc:1226] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:35.533944 5763 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:35.523110 5761 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:35.486919 8609 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:35.509536 5501 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.524274 5765 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:35.524668 5545 raft_consensus.cc:1226] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:35.541251 5765 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:35.498023 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:35.525916 8671 log.cc:924] Time spent T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.082s user 0.000s sys 0.000s
I20260807 13:33:35.494088 8353 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:35.531126 8635 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.484915 8678 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260807 13:33:35.543447 5620 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:35.561048 5620 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:35.545768 8637 consensus_meta.cc:287] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.555s user 0.004s sys 0.005s
I20260807 13:33:35.546751 8607 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.550143 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 13:33:35.551216 5767 raft_consensus.cc:1261] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:33:35.613960 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 101817us
I20260807 13:33:35.625839 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:35.626330 8335 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:35.557169 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 47717.9us
I20260807 13:33:35.617029 8675 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.627461 5501 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:35.628572 5501 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.628942 8675 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.626957 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.632164 8675 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:35.617264 8637 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:35.632748 5770 raft_consensus.cc:1226] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:35.633407 5767 raft_consensus.cc:1261] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:35.550170 8609 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:35.635967 8572 consensus_meta.cc:287] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.829s user 0.002s sys 0.009s
I20260807 13:33:35.636797 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:35.637408 6691 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:35.637331 8609 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:35.597057 8639 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:35.638680 8639 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:35.639048 8639 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:35.559823 8612 raft_consensus.cc:3032] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:35.556404 8677 raft_consensus.cc:3032] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:35.589573 8016 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:35.642194 8612 raft_consensus.cc:729] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:35.642344 8016 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:35.642526 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:35.643006 8016 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:35.643400 6685 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:35.643606 8612 consensus_queue.cc:260] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.645192 5503 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:35.645404 8612 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:35.646100 8609 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:35.646433 8677 raft_consensus.cc:729] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:35.646692 8609 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:35.647327 8609 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:35.647845 8677 consensus_queue.cc:260] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.649577 8677 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:35.612380 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:35.650635 8674 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:35.651510 8641 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:35.651896 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:35.620573 5620 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:35.634246 5501 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.655887 5501 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.656867 5501 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.657685 5501 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.634413 8637 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:35.632298 5771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1386) took 2018 ms (client timeout 2034 ms). Trace:
W20260807 13:33:35.661772 5771 rpcz_store.cc:269] 0807 13:33:33.613952 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:33.614070 (+ 118us) service_pool.cc:227] Handling call
0807 13:33:35.630657 (+2016587us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540020c1d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:35.632246 (+ 1589us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1179574016}
I20260807 13:33:35.662039 5767 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260807 13:33:35.662509 5767 pending_rounds.cc:76] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 6
I20260807 13:33:35.662714 5767 pending_rounds.cc:97] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260807 13:33:35.662936 5767 raft_consensus.cc:2866] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:35.662818 5620 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:35.662906 5501 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.558456 5761 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:35.634698 8353 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:35.640995 8664 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:35.659637 8635 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:35.562667 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:35.673233 5765 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:35.611274 8670 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:35.666726 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:35.675276 5620 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:35.675706 5501 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.676260 5620 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:35.679394 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:35.679728 5620 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:35.665282 8498 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:33:35.680608 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:35.680244 5501 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.683327 5620 leader_election.cc:398] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5.
I20260807 13:33:35.621451 8333 consensus_queue.cc:1046] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260807 13:33:35.665756 8440 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:35.686241 5658 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:35.686834 5620 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:35.670855 8588 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:33:35.676994 8675 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:35.678503 8653 raft_consensus.cc:2726] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:35.680027 8637 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:35.678831 8355 raft_consensus.cc:2781] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:35.695875 8678 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:35.681069 8652 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:35.680545 8547 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:35.697278 5501 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.701371 8440 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:35.679186 8670 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.673511 8674 consensus_queue.cc:1046] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260807 13:33:35.666139 8666 consensus_queue.cc:1046] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 13:33:35.735987 5501 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:35.703181 8016 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.714257 8355 raft_consensus.cc:686] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:35.715255 8639 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:35.717105 8642 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:35.724453 8335 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:35.727103 5662 raft_consensus.cc:2396] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:35.677057 8353 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.688553 8692 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:35.747732 8666 raft_consensus.cc:3032] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:35.749871 5501 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:35.750744 8694 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:35.750831 8653 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 13:33:35.751899 8640 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:35.726438 8440 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:35.741166 8652 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:35.757342 8666 raft_consensus.cc:729] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:35.762238 8440 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:35.761515 8355 consensus_queue.cc:237] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.775424 8639 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:35.764038 8609 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:35.777948 8609 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:35.778537 8678 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:35.779837 6680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57224 (request call id 176) took 1151 ms. Trace:
I20260807 13:33:35.780310 6680 rpcz_store.cc:276] 0807 13:33:34.628533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.637303 (+ 8770us) service_pool.cc:227] Handling call
0807 13:33:34.671599 (+ 34296us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:34.682729 (+ 11130us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:35.779519 (+1096790us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b54004fecd0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:35.779752 (+ 233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":56166272}
I20260807 13:33:35.783051 8670 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:35.784504 8363 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:35.808176 8666 consensus_queue.cc:260] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.811064 8666 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:35.839064 8693 log.cc:924] Time spent T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.086s user 0.000s sys 0.002s
I20260807 13:33:35.842895 8675 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:35.843237 8611 raft_consensus.cc:3032] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:35.844076 8611 raft_consensus.cc:729] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:35.849993 8646 log.cc:924] Time spent T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.874s user 0.003s sys 0.000s
W20260807 13:33:35.851718 8691 log.cc:924] Time spent T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.156s user 0.000s sys 0.004s
I20260807 13:33:35.854629 8554 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:35.845844 8611 consensus_queue.cc:260] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:35.857071 8611 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
W20260807 13:33:35.858937 8654 log.cc:924] Time spent T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.874s user 0.002s sys 0.000s
I20260807 13:33:35.865393 8627 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:35.866295 8627 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:35.872496 8644 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 1.040s user 0.027s sys 0.020s
I20260807 13:33:35.872377 8627 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.917330 5543 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
W20260807 13:33:35.918609 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 231697us
W20260807 13:33:35.909864 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 159748us
I20260807 13:33:35.920806 5666 raft_consensus.cc:2396] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 13:33:35.925671 5666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1445) took 1709 ms (client timeout 1822 ms). Trace:
I20260807 13:33:35.920765 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1074) took 1657 ms. Trace:
I20260807 13:33:35.916858 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:35.828083 8466 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.228s user 0.005s sys 0.011s
I20260807 13:33:35.931399 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 1095) took 1125 ms. Trace:
I20260807 13:33:35.928273 5556 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:35.945307 6694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57224 (request call id 175) took 1361 ms. Trace:
W20260807 13:33:35.952905 8466 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.359s user 0.005s sys 0.011s
W20260807 13:33:35.926220 5666 rpcz_store.cc:269] 0807 13:33:34.216222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.216345 (+ 123us) service_pool.cc:227] Handling call
0807 13:33:35.925311 (+1708966us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000a9e54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:35.925515 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3747138944}
I20260807 13:33:35.939321 5766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1388) took 2324 ms. Trace:
I20260807 13:33:35.978402 5662 rpcz_store.cc:276] 0807 13:33:34.805459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.814936 (+ 9477us) service_pool.cc:227] Handling call
0807 13:33:35.930928 (+1115992us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400102054. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:35.931221 (+ 293us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2052320640}
I20260807 13:33:35.954191 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:35.926957 5543 rpcz_store.cc:276] 0807 13:33:34.263207 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.459357 (+196150us) service_pool.cc:227] Handling call
0807 13:33:35.915986 (+1456629us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800003398. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:35.916605 (+ 619us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:35.919152 (+ 2547us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:35.920615 (+ 1463us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4734208}
I20260807 13:33:35.997116 6694 rpcz_store.cc:276] 0807 13:33:34.583364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.583732 (+ 368us) service_pool.cc:227] Handling call
0807 13:33:34.584156 (+ 424us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:34.584566 (+ 410us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:34.584604 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:34.587133 (+ 2529us) log.cc:842] Serialized 26 byte log entry
0807 13:33:34.740393 (+153260us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:33:34.740419 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:34.740462 (+ 43us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:35.870543 (+1130081us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:35.944566 (+ 74023us) raft_consensus.cc:1671] finished
0807 13:33:35.944607 (+ 41us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:35.945082 (+ 475us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1900,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7869,"spinlock_wait_cycles":66260224,"thread_start_us":113724,"threads_started":1,"wal-append.queue_time_us":193809}
I20260807 13:33:35.951126 8070 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:35.944332 6691 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:35.928392 5501 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:36.007647 5556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 1098) took 1506 ms (client timeout 1505 ms). Trace:
I20260807 13:33:35.940732 8016 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.948585 8353 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:35.943653 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:36.013900 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 105) took 1711 ms. Trace:
W20260807 13:33:36.015623 5556 rpcz_store.cc:269] 0807 13:33:34.494610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.494740 (+ 130us) service_pool.cc:227] Handling call
0807 13:33:35.916347 (+1421607us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b5800003398. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:36.000520 (+ 84173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5468416}
I20260807 13:33:35.962352 8445 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:36.027007 6685 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:36.027467 5620 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:36.030714 6688 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
W20260807 13:33:36.031098 8721 log.cc:924] Time spent T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
I20260807 13:33:36.031940 8608 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:36.034650 8643 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:36.035511 8643 raft_consensus.cc:686] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.036864 5662 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 13:33:36.036991 8643 consensus_queue.cc:237] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.038956 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:33:36.040231 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:33:36.047869 8070 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.049857 8664 raft_consensus.cc:3032] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:36.050350 8664 raft_consensus.cc:729] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:36.051424 5544 raft_consensus.cc:1226] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:36.052349 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1073) took 1789 ms. Trace:
I20260807 13:33:36.052731 5544 rpcz_store.cc:276] 0807 13:33:34.262909 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.429687 (+166778us) service_pool.cc:227] Handling call
0807 13:33:36.050570 (+1620883us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b5800003398. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:36.050875 (+ 305us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:36.052028 (+ 1153us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.052296 (+ 268us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4884224}
I20260807 13:33:36.057914 5763 raft_consensus.cc:1261] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:36.058650 8694 raft_consensus.cc:686] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:36.060341 8694 consensus_queue.cc:237] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.064128 5662 raft_consensus.cc:1226] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 5. Current term is 6. Ops: []
W20260807 13:33:36.068212 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 140128us
I20260807 13:33:36.070344 8445 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:36.073424 5503 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:36.074787 8070 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:36.075829 8608 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:36.076594 8608 raft_consensus.cc:686] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:36.078296 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:36.009181 5766 rpcz_store.cc:276] 0807 13:33:33.614635 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:33.633058 (+ 18423us) service_pool.cc:227] Handling call
0807 13:33:34.506995 (+873937us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b5800004298. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:34.522720 (+ 15725us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:34.574413 (+ 51693us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:34.582213 (+ 7800us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:34.657422 (+ 75209us) log.cc:842] Serialized 52 byte log entry
0807 13:33:34.799811 (+142389us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:35.058245 (+258434us) log.cc:842] Serialized 14 byte log entry
0807 13:33:35.113389 (+ 55144us) log.cc:842] Serialized 14 byte log entry
0807 13:33:35.117490 (+ 4101us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:35.117573 (+ 83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:35.865812 (+748239us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b540038eda0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682304771 00007ff68230f220 00007ff68230f1c8 00007ff68230f148 00007ff68230f103 00007ff68230e38c 00007ff68837f206 00007ff688377808 00007ff68234b38b 00007ff68234de80
0807 13:33:35.938670 (+ 72858us) raft_consensus.cc:1671] finished
0807 13:33:35.938724 (+ 54us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:35.939073 (+ 349us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3398,"prepare.queue_time_us":261844,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":17727,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":9620,"spinlock_wait_cycles":52155648,"thread_start_us":310636,"threads_started":2,"wal-append.queue_time_us":135317}
W20260807 13:33:36.081353 5769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1421) took 2204 ms (client timeout 1931 ms). Trace:
I20260807 13:33:36.081442 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 1105) took 1403 ms. Trace:
I20260807 13:33:36.078474 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.086833 5542 rpcz_store.cc:276] 0807 13:33:34.678392 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.775017 (+ 96625us) service_pool.cc:227] Handling call
0807 13:33:36.081042 (+1306025us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54001da454. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:36.081275 (+ 233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":585917696}
I20260807 13:33:36.092149 5554 raft_consensus.cc:2396] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260807 13:33:36.092623 5554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 1099) took 1597 ms (client timeout 1892 ms). Trace:
W20260807 13:33:36.093078 5554 rpcz_store.cc:269] 0807 13:33:34.494945 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.495120 (+ 175us) service_pool.cc:227] Handling call
0807 13:33:36.065273 (+1570153us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800003398. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:36.092546 (+ 27273us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2757504}
I20260807 13:33:36.052001 8664 consensus_queue.cc:260] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:36.086779 5769 rpcz_store.cc:269] 0807 13:33:33.876787 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.182243 (+305456us) service_pool.cc:227] Handling call
0807 13:33:36.080863 (+1898620us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54003c8554. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:36.081089 (+ 226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1419776896}
I20260807 13:33:36.102334 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1103) took 1456 ms. Trace:
I20260807 13:33:36.102829 5545 rpcz_store.cc:276] 0807 13:33:34.645849 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.824529 (+178680us) service_pool.cc:227] Handling call
0807 13:33:34.824815 (+ 286us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:35.551746 (+726931us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.101683 (+549937us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400022954. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:36.102066 (+ 383us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1609125760}
I20260807 13:33:36.077915 8608 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:36.093240 8440 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:35.297691 5762 rpcz_store.cc:276] 0807 13:33:33.980208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:35.160180 (+1179972us) service_pool.cc:227] Handling call
0807 13:33:35.294430 (+134250us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:35.295878 (+ 1448us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:35.295904 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:35.295942 (+ 38us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:35.295969 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:35.296023 (+ 54us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:35.296119 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2317}
W20260807 13:33:36.112800 8550 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.925s user 0.019s sys 0.010s
W20260807 13:33:36.134826 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 55769.3us
W20260807 13:33:36.150743 8552 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.570s user 0.006s sys 0.008s
I20260807 13:33:36.159171 5666 raft_consensus.cc:1226] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260807 13:33:36.152787 8550 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.057s user 0.020s sys 0.010s
I20260807 13:33:36.136889 8417 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:36.174783 8664 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:36.178970 8586 raft_consensus.cc:3032] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:36.179517 8586 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:36.170683 8552 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.726s user 0.006s sys 0.008s
I20260807 13:33:36.184194 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1083) took 1398 ms. Trace:
I20260807 13:33:36.186384 8578 consensus_queue.cc:1046] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 13:33:36.191151 5764 raft_consensus.cc:1226] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:36.191874 8578 raft_consensus.cc:3032] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:36.192569 8578 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.192997 5656 raft_consensus.cc:1226] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:36.193665 5764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1151) took 2250 ms. Trace:
I20260807 13:33:36.198087 8440 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:36.187840 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1451) took 1948 ms. Trace:
I20260807 13:33:36.189616 8584 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:36.199497 8601 consensus_queue.cc:1046] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 13:33:36.186494 5391 catalog_manager.cc:5495] T dc4a6a8da3ec47dc859ce24a3852828d P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 3 to 5, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 5 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:33:36.196276 8498 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260807 13:33:36.192020 5659 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1458) took 1704 ms (client timeout 2167 ms). Trace:
I20260807 13:33:36.193846 8578 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:36.190618 5660 rpcz_store.cc:276] 0807 13:33:34.785377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.785959 (+ 582us) service_pool.cc:227] Handling call
0807 13:33:34.786310 (+ 351us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:34.787155 (+ 845us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:34.787211 (+ 56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:35.929105 (+1141894us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b1800334600. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f41bf96 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff680d59e11 00007ff680d69442 00007ff6823b1c11 00007ff68237658a
0807 13:33:35.932044 (+ 2939us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b2c0004af28. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff680d59e11 00007ff680d69442 00007ff6823b1c11 00007ff68237658a 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772
0807 13:33:35.932948 (+ 904us) log.cc:842] Serialized 26 byte log entry
0807 13:33:36.020647 (+ 87699us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:36.022437 (+ 1790us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.046282 (+ 23845us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:36.182976 (+136694us) raft_consensus.cc:1671] finished
0807 13:33:36.182993 (+ 17us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:36.184013 (+ 1020us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":397,"raft.queue_time_us":764,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":16031,"spinlock_wait_cycles":30681088,"thread_start_us":87237,"threads_started":1,"wal-append.queue_time_us":189789}
I20260807 13:33:36.204768 7884 raft_consensus.cc:3032] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:36.197780 5764 rpcz_store.cc:276] 0807 13:33:33.943481 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.685785 (+742304us) service_pool.cc:227] Handling call
0807 13:33:34.686068 (+ 283us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:36.191712 (+1505644us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.193351 (+ 1639us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540036bfd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:36.193570 (+ 219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3460260608}
W20260807 13:33:36.201421 5659 rpcz_store.cc:269] 0807 13:33:34.487822 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.494228 (+ 6406us) service_pool.cc:227] Handling call
0807 13:33:36.191582 (+1697354us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54001ba8d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:36.191802 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1825108224}
I20260807 13:33:36.199493 5667 rpcz_store.cc:276] 0807 13:33:34.238804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.247301 (+ 8497us) service_pool.cc:227] Handling call
0807 13:33:34.247564 (+ 263us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:34.456210 (+208646us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.187392 (+1731182us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400101154. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:36.187653 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":319339904}
I20260807 13:33:36.216481 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
W20260807 13:33:36.217947 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 47448.1us
I20260807 13:33:36.221217 8554 consensus_queue.cc:1046] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:36.222373 8554 consensus_queue.cc:1225] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:33:36.222500 8716 consensus_queue.cc:1046] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:36.223124 8554 consensus_queue.cc:1046] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:36.223794 8716 raft_consensus.cc:3032] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:36.223656 8252 consensus_queue.cc:1046] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:36.221241 8440 consensus_queue.cc:1046] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:36.224270 8627 raft_consensus.cc:3032] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:36.224789 8627 raft_consensus.cc:729] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.224828 8440 consensus_queue.cc:1225] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:33:36.225081 8430 raft_consensus.cc:3032] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:36.225502 8430 raft_consensus.cc:729] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.225536 8440 raft_consensus.cc:3032] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:33:36.020089 5548 rpcz_store.cc:276] 0807 13:33:34.264262 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.459957 (+195695us) service_pool.cc:227] Handling call
0807 13:33:35.923422 (+1463465us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800003398. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:35.923865 (+ 443us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:35.924479 (+ 614us) raft_consensus.cc:1520] Early marking committed up to index 6
0807 13:33:35.925203 (+ 724us) log.cc:842] Serialized 14 byte log entry
0807 13:33:35.975168 (+ 49965us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:35.975216 (+ 48us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:33:35.975258 (+ 42us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:35.975322 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:35.975465 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":72313,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":2942,"spinlock_wait_cycles":6574592,"thread_start_us":48958,"threads_started":1,"wal-append.queue_time_us":49507}
I20260807 13:33:36.226048 8440 raft_consensus.cc:729] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.212483 7884 raft_consensus.cc:729] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:36.224315 8716 raft_consensus.cc:729] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.225971 8627 consensus_queue.cc:260] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.232208 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1106) took 1173 ms. Trace:
I20260807 13:33:36.200497 5722 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:36.169351 8550 raft_consensus.cc:686] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.200078 8584 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.254806 8584 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:36.255738 8430 consensus_queue.cc:260] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.256467 8643 consensus_queue.cc:1046] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:36.257421 8430 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:36.257974 8643 consensus_queue.cc:1046] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:36.258994 8355 raft_consensus.cc:3032] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:36.259393 8355 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.181354 8586 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:36.266637 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 66441.6us
W20260807 13:33:36.269901 8709 log.cc:924] Time spent T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.188s user 0.004s sys 0.000s
I20260807 13:33:36.270452 5770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1157) took 1571 ms. Trace:
I20260807 13:33:36.271127 8355 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.271518 8726 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 13:33:36.272138 6685 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:36.272611 8440 consensus_queue.cc:260] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.273598 5763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1182) took 1037 ms. Trace:
I20260807 13:33:36.274067 8607 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:36.277240 5620 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:36.276985 8611 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260807 13:33:36.281708 8355 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.281903 5503 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:36.282140 8554 consensus_queue.cc:1035] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:36.282835 8554 consensus_queue.cc:1225] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:33:36.278985 5763 rpcz_store.cc:276] 0807 13:33:35.236518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:35.537704 (+301186us) service_pool.cc:227] Handling call
0807 13:33:35.538010 (+ 306us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:36.058682 (+520672us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.273261 (+214579us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400287154. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:36.273536 (+ 275us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1187423104}
I20260807 13:33:36.274330 8643 consensus_queue.cc:1035] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260807 13:33:36.276177 5770 rpcz_store.cc:276] 0807 13:33:34.698791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:35.368872 (+670081us) service_pool.cc:227] Handling call
0807 13:33:35.632411 (+263539us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:35.633229 (+ 818us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.250433 (+617204us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540020c1d0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:36.270219 (+ 19786us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":527374208}
I20260807 13:33:36.284585 5722 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:36.288195 8627 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:36.281782 8548 consensus_queue.cc:1046] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260807 13:33:36.290190 8611 consensus_queue.cc:1225] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:33:36.292837 8548 raft_consensus.cc:3032] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:36.293375 8548 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:36.292702 8733 log.cc:924] Time spent T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
I20260807 13:33:36.294252 8239 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:36.294843 8239 raft_consensus.cc:686] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:36.283767 8550 consensus_queue.cc:237] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.296989 8588 raft_consensus.cc:3032] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:36.296636 8239 consensus_queue.cc:237] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.286393 8464 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:36.305410 8464 raft_consensus.cc:686] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:36.306630 8464 consensus_queue.cc:237] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:36.307636 8016 raft_consensus.cc:3032] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:36.308037 8016 raft_consensus.cc:729] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.308950 8016 consensus_queue.cc:260] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.297955 8440 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:36.294641 8548 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.312760 8548 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.313498 8603 raft_consensus.cc:3032] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:36.313943 8603 raft_consensus.cc:729] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.314975 8603 consensus_queue.cc:260] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.316359 8603 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.298377 7812 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:36.323022 7812 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:36.323256 5665 raft_consensus.cc:2396] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:36.323427 7812 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.324610 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 1097) took 1513 ms. Trace:
I20260807 13:33:36.324939 5665 rpcz_store.cc:276] 0807 13:33:34.811419 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.991073 (+179654us) service_pool.cc:227] Handling call
0807 13:33:36.324388 (+1333315us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000aad54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:36.324562 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3053881088}
I20260807 13:33:36.326427 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1472) took 1032 ms. Trace:
I20260807 13:33:36.326860 5666 rpcz_store.cc:276] 0807 13:33:35.293664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:36.010351 (+716687us) service_pool.cc:227] Handling call
0807 13:33:36.011081 (+ 730us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:36.161374 (+150293us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.326148 (+164774us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400100c54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:36.326349 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":322619648}
W20260807 13:33:36.299101 8727 log.cc:924] Time spent T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.085s user 0.000s sys 0.000s
I20260807 13:33:36.300284 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1470) took 1128 ms. Trace:
I20260807 13:33:36.246528 5656 rpcz_store.cc:276] 0807 13:33:35.058511 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:35.698561 (+640050us) service_pool.cc:227] Handling call
0807 13:33:36.192579 (+494018us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:36.193520 (+ 941us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.231886 (+ 38366us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54001ba8d0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:36.232111 (+ 225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1134970240}
I20260807 13:33:36.303308 8588 raft_consensus.cc:729] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.302213 7884 consensus_queue.cc:260] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:36.304833 8578 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:36.348421 8016 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.338162 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.332631 5658 rpcz_store.cc:276] 0807 13:33:35.162474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:36.107961 (+945487us) service_pool.cc:227] Handling call
0807 13:33:36.108488 (+ 527us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:36.108978 (+ 490us) raft_consensus.cc:1520] Early marking committed up to index 4
0807 13:33:36.152407 (+ 43429us) log.cc:842] Serialized 14 byte log entry
0807 13:33:36.289523 (+137116us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:36.289577 (+ 54us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:36.289610 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.289671 (+ 61us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:36.290467 (+ 796us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":47708,"prepare.queue_time_us":26342,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":25386,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2990,"thread_start_us":98249,"threads_started":2,"wal-append.queue_time_us":114198}
W20260807 13:33:36.337929 5501 connection.cc:232] RPC call timeout handler was delayed by -1.2853999689687043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260807 13:33:36.362720 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1453) took 1905 ms. Trace:
I20260807 13:33:36.363056 5663 rpcz_store.cc:276] 0807 13:33:34.456679 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.456814 (+ 135us) service_pool.cc:227] Handling call
0807 13:33:34.457210 (+ 396us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:34.799392 (+342182us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.357265 (+1557873us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54000cdd54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:36.361524 (+ 4259us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":785412352}
W20260807 13:33:36.364658 8740 log.cc:924] Time spent T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.094s user 0.003s sys 0.000s
I20260807 13:33:36.364708 8428 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.353545 8643 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:36.367390 8643 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:36.367792 8643 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:36.303581 8716 consensus_queue.cc:260] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.371752 5763 raft_consensus.cc:2379] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:36.375994 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.373955 5391 catalog_manager.cc:5495] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 2 to 3, leader changed from d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:36.376981 5770 raft_consensus.cc:2379] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:36.378204 8588 consensus_queue.cc:260] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.379871 8588 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:36.384809 6688 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:36.386030 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:36.388293 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.389016 7812 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.391120 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.391402 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.392234 5659 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:36.392441 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.393206 5665 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.393277 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.393388 8466 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:36.394610 8570 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:36.394402 8466 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.395084 8570 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.396517 8466 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:36.397015 8570 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:36.397132 8466 consensus_queue.cc:1046] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260807 13:33:36.398290 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 121212us
I20260807 13:33:36.398533 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.399471 5660 raft_consensus.cc:2379] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:36.401743 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.402426 5662 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.407766 8586 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:36.409019 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.410291 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.412869 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.413607 5659 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:36.423565 7812 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:36.425235 5665 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:36.428398 8716 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:36.430348 5662 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:36.434867 5658 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260807 13:33:36.434553 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.442377 8611 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:36.435163 5658 pending_rounds.cc:76] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting all ops after (but not including) 2
I20260807 13:33:36.443768 5658 pending_rounds.cc:97] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260807 13:33:36.449384 7884 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:36.450057 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:36.451015 5658 raft_consensus.cc:2866] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:36.469066 8016 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:36.472705 5660 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:33:36.469540 8016 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.477126 8016 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:36.480928 5554 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:36.492619 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.494741 8355 consensus_queue.cc:1046] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260807 13:33:36.495518 8355 consensus_queue.cc:1225] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 13:33:36.507975 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:36.508563 5554 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:36.510228 5556 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:36.515347 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.516072 5542 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 1.
I20260807 13:33:36.516471 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.517246 5660 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:36.517515 5543 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: []
I20260807 13:33:36.517961 8373 raft_consensus.cc:3032] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:36.518380 8373 raft_consensus.cc:729] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:36.519332 8373 consensus_queue.cc:260] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:36.520661 8373 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:36.522461 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.523376 5543 raft_consensus.cc:2379] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:36.526983 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.537997 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:36.540190 5663 raft_consensus.cc:3032] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:36.540647 5663 raft_consensus.cc:729] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:36.541538 5663 consensus_queue.cc:260] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.548256 5543 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:36.561911 8735 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.215s user 0.006s sys 0.000s
I20260807 13:33:36.564935 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:36.565536 5542 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260807 13:33:36.565693 5763 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.567205 5663 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.569456 8466 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:36.570118 8466 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:36.582773 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.582406 5554 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:36.581835 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.554001 5548 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9417f147a78e41728d00594b19828f18"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:54404
I20260807 13:33:36.587759 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.586611 5548 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:33:36.591393 5545 raft_consensus.cc:1226] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:36.587229 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:36.595037 5548 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:36.594957 5542 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:36.596328 5770 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:36.563961 8643 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.600273 5661 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:36.600363 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.600522 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.601274 5771 raft_consensus.cc:2396] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:36.602499 5667 raft_consensus.cc:1261] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:36.602999 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.603308 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.604243 8466 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:36.606009 5658 raft_consensus.cc:1261] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 13:33:36.606413 5658 pending_rounds.cc:76] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting all ops after (but not including) 1
I20260807 13:33:36.606675 5658 pending_rounds.cc:97] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:33:36.606920 5658 raft_consensus.cc:2866] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:36.610575 5762 raft_consensus.cc:1261] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:36.616712 5665 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:36.609807 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:36.611256 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.623052 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:36.623258 6688 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 13:33:36.624890 8653 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 13:33:36.625314 5766 raft_consensus.cc:1226] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:36.621711 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.634259 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:36.635025 5667 raft_consensus.cc:2379] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:36.629218 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:36.620725 8741 log.cc:924] Time spent T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.182s user 0.001s sys 0.000s
I20260807 13:33:36.633320 5545 raft_consensus.cc:1261] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:36.635591 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:36.639216 5545 raft_consensus.cc:1261] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:36.645921 5660 raft_consensus.cc:1226] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:36.648204 5663 raft_consensus.cc:1261] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:33:36.648381 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:36.650362 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1089) took 1859 ms. Trace:
I20260807 13:33:36.650807 5661 rpcz_store.cc:276] 0807 13:33:34.790691 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:35.007307 (+216616us) service_pool.cc:227] Handling call
0807 13:33:35.007627 (+ 320us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:36.600747 (+1593120us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:36.650074 (+ 49327us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54000ab254. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:36.650297 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3651256576}
I20260807 13:33:36.654587 5666 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:36.648564 5663 pending_rounds.cc:76] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting all ops after (but not including) 2
I20260807 13:33:36.655660 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:36.660894 5663 pending_rounds.cc:97] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:33:36.661360 5663 raft_consensus.cc:2866] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:36.663991 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.665115 8664 consensus_queue.cc:1046] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 13:33:36.666194 8355 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260807 13:33:36.666136 8664 raft_consensus.cc:3032] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:36.661990 5545 raft_consensus.cc:1261] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:36.676005 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.676976 5542 raft_consensus.cc:1261] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:36.679872 5545 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:36.672067 8664 raft_consensus.cc:729] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:33:36.678756 8745 log.cc:924] Time spent T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.142s user 0.001s sys 0.000s
I20260807 13:33:36.689600 5763 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:36.690768 5769 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260807 13:33:36.692837 5656 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:36.683353 8464 consensus_queue.cc:1046] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260807 13:33:36.698921 5764 raft_consensus.cc:1261] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260807 13:33:36.704018 8751 log.cc:924] Time spent T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.087s user 0.001s sys 0.000s
I20260807 13:33:36.700292 8664 consensus_queue.cc:260] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.705962 8664 raft_consensus.cc:3037] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:36.700273 8355 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:36.710664 8355 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.700520 8643 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:36.712791 8355 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:36.722489 8445 raft_consensus.cc:3032] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:36.722906 8445 raft_consensus.cc:729] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:36.715222 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.721521 5659 raft_consensus.cc:1261] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260807 13:33:36.725409 5542 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:36.725625 5659 pending_rounds.cc:76] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting all ops after (but not including) 2
I20260807 13:33:36.727142 5659 pending_rounds.cc:97] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260807 13:33:36.727371 5659 raft_consensus.cc:2866] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:36.728550 5389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51228 (request call id 182) took 10341 ms. Trace:
I20260807 13:33:36.724210 8445 consensus_queue.cc:260] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:36.732765 5542 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:36.728929 5389 rpcz_store.cc:276] 0807 13:33:26.386906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:26.387108 (+ 202us) service_pool.cc:227] Handling call
0807 13:33:26.503831 (+116723us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b54002efed4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6882d0d6c 00007ff6883cac3e 00007ff6866dcfb4 00007ff6866dcf42 00007ff6866dce71 00007ff6866dcdec 00007ff6866dc0a2 00007ff6807a094c 00007ff68079fd86
0807 13:33:36.728335 (+10224504us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:32.756147 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:32.756688 (+ 541us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:32.756727 (+ 39us) write_op.cc:435] Acquired schema lock
0807 13:33:32.756739 (+ 12us) tablet.cc:660] Decoding operations
0807 13:33:32.762252 (+ 5513us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:32.762312 (+ 60us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:32.762344 (+ 32us) tablet.cc:683] Acquiring locks for 22 operations
0807 13:33:32.763831 (+ 1487us) tablet.cc:699] Row locks acquired
0807 13:33:32.763850 (+ 19us) write_op.cc:260] PREPARE: finished
0807 13:33:32.763977 (+ 127us) write_op.cc:270] Start()
0807 13:33:32.764082 (+ 105us) write_op.cc:276] Timestamp: P: 1786109612763935 usec, L: 0
0807 13:33:32.764101 (+ 19us) op_driver.cc:331] REPLICATION: starting
0807 13:33:32.764742 (+ 641us) log.cc:842] Serialized 8675 byte log entry
0807 13:33:33.431681 (+666939us) op_driver.cc:444] REPLICATION: finished
0807 13:33:34.075896 (+644215us) write_op.cc:301] APPLY: starting
0807 13:33:34.083821 (+ 7925us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:34.208387 (+124566us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:34.256481 (+ 48094us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:34.431779 (+175298us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:34.432134 (+ 355us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0807 13:33:34.432231 (+ 97us) write_op.cc:312] APPLY: finished
0807 13:33:34.432738 (+ 507us) log.cc:842] Serialized 151 byte log entry
0807 13:33:34.522175 (+ 89437us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:34.551159 (+ 28984us) write_op.cc:454] Released schema lock
0807 13:33:34.556720 (+ 5561us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:34.586940 (+ 30220us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:34.593567 (+ 6627us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17936,"reported_tablets":43,"spinlock_wait_cycles":98223360,"child_traces":[["op",{"apply.queue_time_us":554506,"apply.run_cpu_time_us":20542,"apply.run_wall_time_us":547682,"num_ops":22,"prepare.queue_time_us":691260,"prepare.run_cpu_time_us":8542,"prepare.run_wall_time_us":43178,"raft.queue_time_us":83603,"raft.run_cpu_time_us":20737,"raft.run_wall_time_us":385125,"replication_time_us":656603,"thread_start_us":1009054,"threads_started":5,"wal-append.queue_time_us":245469,"wal-append.run_cpu_time_us":32028,"wal-append.run_wall_time_us":2643539}]]}
I20260807 13:33:36.733680 5765 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:36.736047 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.736994 8445 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:36.738512 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.739820 5656 raft_consensus.cc:1226] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260807 13:33:36.739985 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.740787 5666 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:36.740731 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.739174 5663 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:36.742170 5543 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:36.746838 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.747942 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.748553 5721 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:36.752642 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.753288 8373 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.753455 5659 raft_consensus.cc:2396] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260807 13:33:36.754693 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.755861 5555 raft_consensus.cc:1261] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:36.755774 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.756534 5552 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:36.757086 5661 raft_consensus.cc:1226] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260807 13:33:36.758101 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.758685 5660 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:36.758831 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:36.757725 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.759718 5555 raft_consensus.cc:2396] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:36.759527 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:36.760177 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:36.760612 5556 raft_consensus.cc:2362] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 5. Re-sending same reply.
I20260807 13:33:36.760977 5659 raft_consensus.cc:2379] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:36.760902 5553 raft_consensus.cc:1226] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:36.771787 5663 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:36.788129 5553 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:33:36.790468 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.791043 5543 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:36.800469 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.800644 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:36.801303 5543 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.803073 6637 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:36.804296 7884 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:36.812702 5548 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.813608 5545 raft_consensus.cc:1226] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:36.818727 5543 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:36.819003 5722 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:36.827121 5722 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:36.828519 8570 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:36.828982 8570 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:36.828821 8239 consensus_queue.cc:1046] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:36.829581 8570 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.828896 8466 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:36.798626 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:36.830508 8466 consensus_queue.cc:1046] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:36.830734 5553 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:36.829370 7812 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:36.797269 5663 raft_consensus.cc:1261] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 13:33:36.795300 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 46930.5us
I20260807 13:33:36.845508 5548 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:36.848362 5721 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:36.859014 5663 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:36.862697 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:36.864244 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:36.878304 5762 raft_consensus.cc:1261] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:36.878728 5769 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:36.884171 5620 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:36.902541 8355 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:36.879771 8373 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:36.903363 5620 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:36.906876 8643 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:36.912461 5620 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:36.915518 5721 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:36.903482 8355 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:36.918277 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:36.945806 5663 raft_consensus.cc:2379] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:36.920002 8756 log.cc:924] Time spent T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.067s user 0.001s sys 0.000s
I20260807 13:33:36.923017 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:36.915087 8588 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:36.915330 8550 consensus_queue.cc:1035] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260807 13:33:36.949852 8588 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:36.953276 8588 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:36.916745 8373 raft_consensus.cc:3032] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
W20260807 13:33:36.955674 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 127115us
I20260807 13:33:36.908798 8716 consensus_queue.cc:1035] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260807 13:33:36.914438 8430 consensus_queue.cc:1046] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260807 13:33:36.911417 8643 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260807 13:33:36.955490 8664 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:36.961061 6680 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 13:33:36.964779 8466 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:36.949096 8355 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:36.965477 5722 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:36.956398 8373 raft_consensus.cc:729] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:36.970721 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 107321us
I20260807 13:33:36.979749 5618 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:36.962783 8239 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:36.973553 8430 consensus_queue.cc:1225] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260807 13:33:36.993294 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 148428us
I20260807 13:33:36.989259 8445 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:37.006768 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 96016.2us
I20260807 13:33:37.008225 5618 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:36.981868 8373 consensus_queue.cc:260] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.009377 8373 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.011461 8603 raft_consensus.cc:3032] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:37.011842 8603 raft_consensus.cc:729] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:37.012729 8603 consensus_queue.cc:260] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.014158 8355 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.018036 7812 raft_consensus.cc:3032] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:37.019944 7812 raft_consensus.cc:729] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:37.013916 8603 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:36.994939 8643 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:37.025216 5499 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:37.024868 8355 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:37.018968 8445 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.021230 8664 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260807 13:33:37.062501 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 68327.1us
I20260807 13:33:37.065348 5618 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:37.030953 8570 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.059715 8466 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:37.035878 8779 consensus_queue.cc:1035] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260807 13:33:37.038425 8776 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260807 13:33:37.076349 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 170501us
I20260807 13:33:37.052265 7812 consensus_queue.cc:260] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.078066 7812 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.078560 8570 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:37.082479 8588 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.074565 8548 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:37.087316 8445 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.070595 8653 raft_consensus.cc:2741] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260807 13:33:37.074532 8763 log.cc:924] Time spent T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.097s user 0.001s sys 0.000s
I20260807 13:33:37.102874 5499 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.103752 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:37.104342 5770 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:37.104934 5721 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.106964 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.111130 5764 raft_consensus.cc:1226] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:37.091948 8588 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.121920 5501 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:37.104547 7812 consensus_queue.cc:1035] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260807 13:33:37.121703 8355 consensus_queue.cc:1035] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 13:33:37.125144 8643 consensus_queue.cc:1046] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:37.126048 8643 raft_consensus.cc:3032] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:37.126400 8643 raft_consensus.cc:729] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:37.126637 8588 consensus_queue.cc:1035] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:37.114717 8792 consensus_queue.cc:1046] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260807 13:33:37.127203 8643 consensus_queue.cc:260] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.114867 8653 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:37.134361 8786 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:37.134842 8786 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:37.135245 8786 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:37.136799 7812 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:37.131189 8653 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.138496 5722 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:37.139868 7812 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:37.140348 7812 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:37.140805 7812 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:37.091660 8239 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260807 13:33:37.131916 8779 consensus_queue.cc:1046] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260807 13:33:37.144140 8779 raft_consensus.cc:3032] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:37.144503 8779 raft_consensus.cc:729] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:37.146895 8466 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:37.147397 8466 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:37.138808 8653 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:37.148375 5722 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:37.149458 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 49493.3us
I20260807 13:33:37.145462 8779 consensus_queue.cc:260] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.152375 8779 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:37.128430 8643 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:37.156716 5499 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:37.168694 5770 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:37.170832 5721 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.172780 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:37.174202 5618 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:37.175498 5620 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:37.179227 8548 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:37.180400 5722 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:37.170919 8776 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:37.170280 8570 consensus_queue.cc:1046] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260807 13:33:37.178164 8239 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:37.179390 8445 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:37.196849 5722 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:37.184496 8664 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:37.183529 8548 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.192554 8588 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:37.194298 8611 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 13:33:37.210798 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 88943.8us
I20260807 13:33:37.212749 5501 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:37.215993 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 47745.5us
I20260807 13:33:37.201236 8373 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:37.202688 8548 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:37.225291 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 104960us
I20260807 13:33:37.226086 5499 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.229323 8779 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:37.229713 8779 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:37.230269 8779 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.199743 8790 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.035s
I20260807 13:33:37.232810 8664 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:37.229656 7812 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.235561 7812 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:37.238407 8789 raft_consensus.cc:3032] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:37.238804 8789 raft_consensus.cc:729] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:37.239553 8789 consensus_queue.cc:260] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.240769 8789 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:37.240480 8548 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.212292 8611 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:37.243258 8611 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:37.248706 5618 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:37.250010 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 53233.8us
W20260807 13:33:37.257660 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 44997.5us
I20260807 13:33:37.262454 5501 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:37.238400 8373 raft_consensus.cc:686] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:37.274420 5391 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36640 (request call id 68) took 6207 ms. Trace:
I20260807 13:33:37.283962 5618 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:37.285820 5501 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:37.271566 7812 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.275453 8792 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:37.279681 8790 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.271559 8776 raft_consensus.cc:686] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:37.277987 8806 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:37.289263 8588 raft_consensus.cc:686] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:37.289458 8548 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.314478 5394 catalog_manager.cc:5495] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:37.316743 5394 catalog_manager.cc:5495] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 5, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 5 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:37.318481 8808 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:37.296360 7812 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.320246 8664 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:37.280099 8464 consensus_queue.cc:1035] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260807 13:33:37.277786 8466 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.278707 8653 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.279047 5391 rpcz_store.cc:276] 0807 13:33:31.062718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:31.074428 (+ 11710us) service_pool.cc:227] Handling call
0807 13:33:37.269825 (+6195397us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:36.459807 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:36.502911 (+ 43104us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:36.502975 (+ 64us) write_op.cc:435] Acquired schema lock
0807 13:33:36.503016 (+ 41us) tablet.cc:660] Decoding operations
0807 13:33:36.503635 (+ 619us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:36.503760 (+ 125us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:36.503831 (+ 71us) tablet.cc:683] Acquiring locks for 2 operations
0807 13:33:36.504374 (+ 543us) tablet.cc:699] Row locks acquired
0807 13:33:36.504415 (+ 41us) write_op.cc:260] PREPARE: finished
0807 13:33:36.504605 (+ 190us) write_op.cc:270] Start()
0807 13:33:36.504762 (+ 157us) write_op.cc:276] Timestamp: P: 1786109616504538 usec, L: 0
0807 13:33:36.504805 (+ 43us) op_driver.cc:331] REPLICATION: starting
0807 13:33:36.533504 (+ 28699us) log.cc:842] Serialized 918 byte log entry
0807 13:33:36.993110 (+459606us) op_driver.cc:444] REPLICATION: finished
0807 13:33:37.193315 (+200205us) write_op.cc:301] APPLY: starting
0807 13:33:37.198299 (+ 4984us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:37.214590 (+ 16291us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:37.224915 (+ 10325us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:37.225432 (+ 517us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:37.225682 (+ 250us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 13:33:37.225735 (+ 53us) write_op.cc:312] APPLY: finished
0807 13:33:37.226060 (+ 325us) log.cc:842] Serialized 28 byte log entry
0807 13:33:37.226322 (+ 262us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:37.226404 (+ 82us) write_op.cc:454] Released schema lock
0807 13:33:37.226462 (+ 58us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:37.226733 (+ 271us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:37.226750 (+ 17us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1622791,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":154069,"apply.run_cpu_time_us":2778,"apply.run_wall_time_us":45144,"num_ops":2,"prepare.queue_time_us":35406,"prepare.run_cpu_time_us":88930,"prepare.run_wall_time_us":219362,"raft.queue_time_us":245264,"raft.run_cpu_time_us":12402,"raft.run_wall_time_us":113874,"replication_time_us":485162,"thread_start_us":321284,"threads_started":4,"wal-append.queue_time_us":153346}]]}
I20260807 13:33:37.304970 8806 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.310672 8716 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:37.335216 5394 catalog_manager.cc:5495] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 4 to 6, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 6 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:37.345005 5721 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.348083 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.348455 5663 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260807 13:33:37.334512 8817 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.332871 8806 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:37.353080 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.353598 8824 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:37.354166 8239 raft_consensus.cc:3032] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:37.326426 8664 consensus_queue.cc:1046] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260807 13:33:37.350401 5394 catalog_manager.cc:5495] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:37.362515 5394 catalog_manager.cc:5495] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 2 to 3, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 3 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:37.353230 5667 raft_consensus.cc:1261] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 13:33:37.348824 5663 pending_rounds.cc:76] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting all ops after (but not including) 7
I20260807 13:33:37.364282 5394 catalog_manager.cc:5495] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:37.365144 5663 pending_rounds.cc:97] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260807 13:33:37.365427 5663 raft_consensus.cc:2866] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:37.353631 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:37.365554 5394 catalog_manager.cc:5495] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 2 to 3, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 3 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:37.367059 5394 catalog_manager.cc:5495] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:37.359896 8239 raft_consensus.cc:729] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:37.368525 5394 catalog_manager.cc:5495] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 4 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:37.352602 5659 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:37.372025 5656 raft_consensus.cc:1261] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:37.376735 5660 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:37.380188 5394 catalog_manager.cc:5495] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:37.382741 5394 catalog_manager.cc:5495] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:37.356027 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.354228 8824 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.358094 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:37.356490 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:37.386021 8824 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.386934 5658 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:37.387362 7812 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:37.357048 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:37.388080 8824 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:37.350919 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 69548.4us
I20260807 13:33:37.359225 5666 raft_consensus.cc:1261] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:37.323671 8790 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.390771 8790 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:37.358228 8588 consensus_queue.cc:237] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.360885 8466 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:37.358641 8814 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:37.369796 8239 consensus_queue.cc:260] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.384536 8445 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:37.384963 8806 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.385151 8786 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.388461 5766 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:37.357511 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:37.397554 5662 raft_consensus.cc:2362] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 5. Re-sending same reply.
I20260807 13:33:37.392915 8821 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.398458 8821 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.387112 8776 consensus_queue.cc:237] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.400413 8821 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.401790 5767 raft_consensus.cc:1261] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 13:33:37.391865 5394 catalog_manager.cc:5495] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 2 to 5, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 5 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:37.402251 5767 pending_rounds.cc:76] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 2
I20260807 13:33:37.406999 5767 pending_rounds.cc:97] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 13:33:37.407240 5767 raft_consensus.cc:2866] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:37.395267 8239 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:37.409829 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:37.397212 8786 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:37.392388 8664 raft_consensus.cc:3032] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:37.410857 8664 raft_consensus.cc:729] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:37.411543 8664 consensus_queue.cc:260] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.412736 8664 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:37.355114 8817 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.414903 8817 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.412736 8653 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.342381 8373 consensus_queue.cc:237] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.416975 8806 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.351434 8716 raft_consensus.cc:686] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:37.419034 5501 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:37.419219 8716 consensus_queue.cc:237] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.420185 5501 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:37.427244 8550 consensus_queue.cc:1035] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:37.427784 5721 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.428493 8786 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:37.429754 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.421969 8653 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:37.430380 5666 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:37.435288 5394 catalog_manager.cc:5495] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 4, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:37.384545 8611 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.436808 8810 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:37.437386 8810 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.438048 8611 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.434904 8806 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:37.439284 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:37.445497 8810 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:37.446241 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 125751us
I20260807 13:33:37.453459 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.454257 5767 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:37.456745 5620 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:37.464110 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.464906 5543 raft_consensus.cc:2396] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:37.465740 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.466060 5548 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:37.466373 5543 raft_consensus.cc:2379] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:37.471395 5662 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:37.477622 5553 raft_consensus.cc:1203] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Deduplicated request from leader. Original: 5.7->[6.8-6.8] Dedup: 6.8->[]
I20260807 13:33:37.478236 5553 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260807 13:33:37.480315 5545 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260807 13:33:37.482237 5554 raft_consensus.cc:1261] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:37.492488 5556 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:37.479439 5544 raft_consensus.cc:1226] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 13:33:37.462006 8806 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.472056 8810 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:37.497454 5555 raft_consensus.cc:1226] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:37.498342 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.502606 5554 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:37.504647 5499 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.503799 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.507157 5553 raft_consensus.cc:2396] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:37.510171 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.510854 5666 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:37.505225 8792 raft_consensus.cc:686] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:37.513674 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.500921 8810 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:37.514402 5658 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:37.483328 8779 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.517825 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.519083 5556 raft_consensus.cc:2396] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260807 13:33:37.508175 8464 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:37.523036 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.522831 8464 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.526914 8464 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.523375 8826 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.525184 5721 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:37.530376 8826 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.501068 8806 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.515786 8653 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.532044 5721 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.531991 8653 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.532640 8826 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.532877 8806 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.533032 8776 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:37.510550 8817 consensus_queue.cc:1035] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260807 13:33:37.510741 8824 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260807 13:33:37.534438 8817 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.534909 8817 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.535559 8792 consensus_queue.cc:237] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.536264 8776 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:37.536847 8817 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.518318 8550 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.537729 8550 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.538830 5556 raft_consensus.cc:1226] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:37.539772 8550 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.540136 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.541213 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.541783 5658 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:37.541906 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.542234 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.542557 5665 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:37.542716 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:37.543625 5661 raft_consensus.cc:2396] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:37.544279 5556 raft_consensus.cc:2379] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:37.544953 8779 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:37.545840 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:37.546411 5556 raft_consensus.cc:1261] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:37.546584 5666 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:37.519110 8810 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:37.534067 8653 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.548350 8779 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:37.551057 8779 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:37.555637 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.556494 5658 raft_consensus.cc:2396] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:37.556943 5499 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.548446 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.558933 5499 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.560021 5499 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.561005 5499 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.561403 8826 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:37.562436 8826 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.562403 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.562927 8826 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:37.563115 5767 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:37.563660 8806 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:37.564019 8806 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.561646 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.564364 8806 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.553357 8464 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.565647 8653 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:37.566228 8653 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.566656 8653 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:37.569864 8464 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.554220 5721 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.571378 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:37.572021 5620 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:37.584389 5658 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.590505 5721 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.583341 5666 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:37.570906 8664 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:37.596292 5721 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.596809 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.598759 5554 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:37.599936 5499 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.588145 8588 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:37.591619 8779 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:37.558933 8373 consensus_queue.cc:1046] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260807 13:33:37.594342 8786 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:37.594395 8464 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.604786 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.598274 8664 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.610409 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.638877 8664 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.639025 5554 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:37.616410 8826 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.595490 8814 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260807 13:33:37.619454 8464 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.621024 5721 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.630200 8776 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:37.604882 8779 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:37.635811 5372 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet fc6f41d0f11d4c6295bae40c23631a4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 14f62bf285c448b9b7a21fabd7a5f0bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:37.600005 8466 consensus_queue.cc:1035] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260807 13:33:37.603792 8817 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:37.604128 8588 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.646288 5553 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:37.647930 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:37.652093 5666 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:37.653434 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.654237 5542 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:37.657138 8776 raft_consensus.cc:686] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:37.654914 8814 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:37.647751 8550 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.648821 8779 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.674728 5555 raft_consensus.cc:1261] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:37.675350 5766 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:37.677016 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.677448 8611 consensus_queue.cc:1046] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:37.661172 8817 raft_consensus.cc:686] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:37.678571 8643 raft_consensus.cc:3032] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:37.678836 8643 raft_consensus.cc:729] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:37.678830 8817 consensus_queue.cc:237] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.679872 8643 consensus_queue.cc:260] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.663139 7812 raft_consensus.cc:3032] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:37.681687 7812 raft_consensus.cc:729] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:37.663323 8824 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.682394 8824 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.682864 7812 consensus_queue.cc:260] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.661041 8253 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:37.684499 8824 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.684954 8253 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:37.689165 8253 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.667541 8464 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.668529 8550 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.677824 5665 raft_consensus.cc:2396] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:37.690570 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.691644 8550 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.694379 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.695228 5661 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:37.684523 7812 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:37.698557 6636 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:37.699559 8643 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.701629 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.702337 5766 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:37.703452 5767 raft_consensus.cc:1226] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:37.703553 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:37.704077 5665 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:37.704995 5658 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:37.655599 8588 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:37.707490 8790 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:37.708022 8466 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:37.724509 8726 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.663762 8776 consensus_queue.cc:237] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.709578 5767 raft_consensus.cc:1226] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:37.725514 8826 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.708521 5721 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.710698 5620 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:37.712745 5666 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:37.719545 5554 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:37.737497 5542 raft_consensus.cc:1226] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:37.708360 8239 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:37.752638 8550 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:37.753135 8550 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.753496 8550 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:37.747277 5545 raft_consensus.cc:1261] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:37.731182 8643 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.710011 5499 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.757951 8643 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.757951 8716 consensus_queue.cc:1046] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:37.759004 8716 raft_consensus.cc:3032] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:37.759361 8716 raft_consensus.cc:729] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:37.760087 8643 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.760275 8716 consensus_queue.cc:260] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:37.760968 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 51064.9us
I20260807 13:33:37.761512 8716 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:37.752596 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.762315 8792 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:37.762904 5543 raft_consensus.cc:2379] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:37.762850 8792 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.763459 8792 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.708876 8814 consensus_queue.cc:1035] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260807 13:33:37.757077 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.757360 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.765265 5499 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.757128 8611 consensus_queue.cc:1046] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:37.747926 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.766222 5552 raft_consensus.cc:2396] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260807 13:33:37.766978 5499 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:37.765276 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.711397 8810 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.771359 8611 raft_consensus.cc:3032] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:33:37.771903 8611 raft_consensus.cc:729] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:37.773036 8611 consensus_queue.cc:260] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:37.775015 8845 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.069s user 0.002s sys 0.000s
I20260807 13:33:37.767493 8239 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:37.783077 5722 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:37.794288 5618 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:37.768627 8464 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
W20260807 13:33:37.796120 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 87717.5us
I20260807 13:33:37.797518 5721 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:37.800014 8548 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:37.800756 8239 raft_consensus.cc:686] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:37.790591 8821 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:37.805521 5618 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:37.806016 5722 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:37.792754 8790 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:37.811254 5722 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:37.802172 8611 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:37.807704 8786 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 13:33:37.809600 8464 raft_consensus.cc:686] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:37.821522 8464 consensus_queue.cc:237] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.814710 8373 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:37.832537 8430 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.833041 8430 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.816592 8814 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:37.834559 8814 raft_consensus.cc:686] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:37.835139 8430 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.835518 8814 consensus_queue.cc:237] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.837256 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.839815 8810 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.843269 8355 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.843739 8355 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.845813 8355 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:37.846849 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.849510 8779 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.819108 8643 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:37.852938 8588 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.858036 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:37.870445 5767 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:37.853248 8664 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.886600 5767 raft_consensus.cc:1261] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:37.896857 5620 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:37.816918 8653 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.902981 5763 raft_consensus.cc:1261] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:37.883273 8253 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.841904 8373 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:37.883165 8821 raft_consensus.cc:686] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:37.925369 5618 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:37.895793 8817 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.867493 8806 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.931967 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:37.905499 8789 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.935818 5770 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:37.939014 5618 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:37.942070 5618 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:37.943243 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.943934 5769 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 13:33:37.916728 8373 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.918085 8826 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.917847 8445 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.926282 8643 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:37.955089 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.957569 8464 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:37.958102 5555 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260807 13:33:37.962082 5544 raft_consensus.cc:2379] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:37.925956 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:37.974364 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.974977 5545 raft_consensus.cc:1226] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:37.952068 8430 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:37.978329 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:37.974951 5544 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 6.
I20260807 13:33:37.981843 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.979609 5501 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:37.980997 5770 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:37.916832 8253 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:37.984097 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.986405 5545 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:37.905687 8239 consensus_queue.cc:237] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.953421 8855 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:37.973348 8440 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:33:37.959982 8643 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.976729 8355 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:37.987182 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.988009 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:37.988379 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:33:38.000835 5763 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:37.983248 8430 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:37.982978 8829 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:38.019150 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.019358 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.005002 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:37.997116 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 100365us
I20260807 13:33:38.020002 5769 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:37.984287 5552 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260807 13:33:37.971040 8824 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:38.023654 5770 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:37.977674 8827 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:37.952252 8789 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.950898 8817 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.970548 8826 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:37.969730 8445 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:38.026885 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 84851.1us
I20260807 13:33:38.011381 8643 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.029775 5769 raft_consensus.cc:1261] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:38.032717 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:37.975150 8464 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.036051 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.021950 8430 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:38.045414 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.047456 5769 raft_consensus.cc:2379] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:38.045075 5618 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:38.036712 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.035658 8779 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:38.068378 8846 log.cc:924] Time spent T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.163s user 0.001s sys 0.000s
I20260807 13:33:38.007485 8855 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:38.071637 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:38.070649 8859 log.cc:924] Time spent T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20260807 13:33:38.084988 5552 raft_consensus.cc:1261] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:38.027984 8824 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:38.050648 8664 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.028816 8792 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.018487 8821 consensus_queue.cc:237] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.087695 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.052400 8588 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:38.099705 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 79309.9us
W20260807 13:33:38.100409 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 45312.2us
W20260807 13:33:38.102186 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 124907us
I20260807 13:33:38.102398 5770 raft_consensus.cc:2379] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:38.102633 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.103497 5763 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
W20260807 13:33:38.108664 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 59401.1us
I20260807 13:33:38.105106 8716 consensus_queue.cc:1035] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260807 13:33:38.110505 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.026404 8829 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:38.031158 8827 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:38.111415 5763 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 8
I20260807 13:33:38.111773 5618 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:38.074371 8653 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.123976 5553 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:38.124382 5618 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:38.127224 5552 raft_consensus.cc:1261] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:38.130383 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.131493 5770 raft_consensus.cc:1261] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:38.090646 8806 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.144896 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.145706 5662 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.090255 8866 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:38.105545 8810 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:38.181178 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:38.181927 5544 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:38.183215 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.183754 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.194232 5767 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:38.184130 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.195070 5658 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:38.120819 8716 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:38.188470 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.200457 5770 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.126223 8779 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:38.194322 5666 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.102142 8355 consensus_queue.cc:1035] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260807 13:33:38.184788 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.213110 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.123870 8857 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:38.218034 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.210646 5618 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:38.213361 5660 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:38.197383 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.219512 5658 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:38.184006 8588 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:38.213840 5661 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:38.221769 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.222419 5665 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:38.183887 8440 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:38.180708 8776 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:38.190284 5763 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:33:38.180691 8664 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:38.226578 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.197813 8464 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.233850 5662 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:38.199887 8864 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:38.241281 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.242031 5763 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.247478 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:38.249011 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.231782 8445 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.221302 8253 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.236125 8817 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.202214 8810 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.264814 5666 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:38.265985 5545 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:38.244366 8440 raft_consensus.cc:686] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:38.226085 8790 consensus_queue.cc:1046] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260807 13:33:38.268217 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.217381 8779 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.248449 8664 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.268396 8881 consensus_queue.cc:1046] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260807 13:33:38.249284 8464 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:38.269098 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.299024 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.234881 8786 consensus_queue.cc:1046] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260807 13:33:38.300352 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 85814.7us
I20260807 13:33:38.266861 8826 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.274937 8864 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 13:33:38.296413 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.271723 8653 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:38.262390 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 206499us
I20260807 13:33:38.237551 8789 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.235613 8868 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:38.240120 8857 raft_consensus.cc:686] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:38.215075 8716 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.260376 5660 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:38.283159 5767 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:38.284673 8792 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.294310 5763 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:38.238037 7812 consensus_queue.cc:1046] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260807 13:33:38.270810 8855 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:38.302752 5499 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:38.314769 5499 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:38.299492 5761 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:38.318077 8789 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:38.318595 8789 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:38.319039 8789 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:38.303967 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.239112 8814 consensus_queue.cc:1035] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260807 13:33:38.217510 8866 consensus_queue.cc:1035] T 2f04480445ab4d6fa33d8835e8337f0c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260807 13:33:38.304291 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.248102 8588 consensus_queue.cc:1035] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260807 13:33:38.305374 5662 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260807 13:33:38.273427 5769 raft_consensus.cc:1261] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:38.305905 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.306236 5765 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:38.277395 8824 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:38.312196 5661 raft_consensus.cc:1261] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 13:33:38.311889 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 91154.3us
I20260807 13:33:38.312433 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.334544 5665 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.284052 5770 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:38.321905 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.322038 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:38.303381 8726 consensus_meta.cc:287] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 0.557s user 0.000s sys 0.010s
I20260807 13:33:38.248325 8776 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:38.337961 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.338465 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.341346 5656 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 6.
I20260807 13:33:38.321028 5499 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:38.343768 6636 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:38.373374 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 52456.4us
I20260807 13:33:38.374286 5499 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:38.334311 8792 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:38.310086 8653 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.335776 8611 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:38.335294 8855 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:38.307214 8464 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.375119 5501 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:38.345155 8726 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:38.382061 5499 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:38.326512 5620 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:38.376569 8792 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:38.382536 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:38.384990 5665 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
W20260807 13:33:38.405086 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 78672.5us
W20260807 13:33:38.435951 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 54506.2us
W20260807 13:33:38.475973 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 101050us
I20260807 13:33:38.394809 8790 consensus_queue.cc:1225] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [LEADER]: Peer 14f62bf285c448b9b7a21fabd7a5f0bf log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:33:38.480374 5501 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:38.328824 8868 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.487653 5499 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:38.415638 8792 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:38.477057 8858 log.cc:924] Time spent T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.252s user 0.000s sys 0.001s
I20260807 13:33:38.475776 8824 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:38.391939 8611 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.481957 8874 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:38.353982 8888 consensus_queue.cc:1035] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260807 13:33:38.506405 8888 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:38.506829 8888 raft_consensus.cc:686] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:38.500870 8882 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:33:38.508074 8882 raft_consensus.cc:686] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:38.503991 8790 raft_consensus.cc:3032] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:38.508560 8790 raft_consensus.cc:729] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:38.508932 8882 consensus_queue.cc:237] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.509809 8611 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.510164 8664 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.510342 8611 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:38.486384 8826 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:38.511029 8826 raft_consensus.cc:686] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:38.510797 8611 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.509449 8790 consensus_queue.cc:260] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.512254 8790 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.511927 8826 consensus_queue.cc:237] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.512738 8611 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.512945 8827 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:38.387042 8440 consensus_queue.cc:237] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.514073 8889 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:38.514810 8889 raft_consensus.cc:686] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:38.515993 8889 consensus_queue.cc:237] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.477756 8857 consensus_queue.cc:237] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.394680 8855 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.523238 5501 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:38.524420 8643 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.504546 8870 consensus_queue.cc:1035] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.127s
I20260807 13:33:38.526352 8870 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:38.526819 8870 raft_consensus.cc:686] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:38.527729 8870 consensus_queue.cc:237] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.504786 8897 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:38.495793 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:38.534407 5501 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:38.535426 8897 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:38.503880 8817 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 13:33:38.536957 5501 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:38.537701 8430 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.538686 8810 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.539474 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:38.482733 8253 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 13:33:38.487001 8550 consensus_meta.cc:287] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.720s user 0.011s sys 0.000s
I20260807 13:33:38.541221 5501 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:38.507604 8888 consensus_queue.cc:237] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.542620 5501 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:38.565802 5766 consensus_meta.cc:287] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.586s user 0.005s sys 0.005s
I20260807 13:33:38.568188 5766 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:38.579978 5501 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:38.585017 5501 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:38.394718 8885 consensus_queue.cc:1035] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.256s
I20260807 13:33:38.540268 8430 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.566128 8253 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:38.566962 8786 raft_consensus.cc:3032] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:38.539484 8716 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.577762 8897 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 13:33:38.598004 5548 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s user 0.000s sys 0.033s
I20260807 13:33:38.578052 8817 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:38.578487 8824 raft_consensus.cc:686] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:33:38.605291 5548 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s user 0.000s sys 0.034s
I20260807 13:33:38.594745 8827 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:38.578651 8550 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:38.612231 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 401658us
W20260807 13:33:38.613440 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 264399us
I20260807 13:33:38.602160 8253 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:38.601809 8905 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:38.601951 8786 raft_consensus.cc:729] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:38.606782 8897 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:38.611462 8779 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:38.628697 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 141484us
I20260807 13:33:38.633570 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:38.632234 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 399114us
I20260807 13:33:38.634259 5767 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:38.623148 8817 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:38.636339 5618 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:38.626807 8897 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:38.645188 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 60324us
I20260807 13:33:38.646621 8814 consensus_queue.cc:1035] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 13:33:38.651367 8890 log.cc:924] Time spent T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260807 13:33:38.653040 8855 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.625329 8905 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.655015 8868 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.656011 8905 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:38.660892 5501 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:38.661376 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.662798 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.636749 8653 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.665411 5722 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:38.665903 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.668540 5767 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:38.645818 8786 consensus_queue.cc:260] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.673909 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.663923 5620 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:38.640421 8885 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:38.677852 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.678234 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:38.679203 5545 raft_consensus.cc:2379] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:38.679728 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:38.678503 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.683885 5543 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:38.685778 5722 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:38.687458 5499 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:38.688192 5620 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:38.693194 5556 raft_consensus.cc:1261] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:38.694185 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.688839 8905 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:38.697656 8905 raft_consensus.cc:686] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:38.698474 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.698602 8905 consensus_queue.cc:237] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.702210 5764 raft_consensus.cc:1261] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:38.702685 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.703095 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.703373 5556 raft_consensus.cc:2379] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:38.703470 8885 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:38.704160 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.704008 8885 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.704371 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.704782 5769 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:38.704941 5556 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:38.705528 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.706310 8892 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:38.697010 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.706661 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.707211 5658 raft_consensus.cc:2354] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:38.707697 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:38.708422 6680 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:38.709316 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.705822 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.709928 5548 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:38.706547 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.710801 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:38.706808 8892 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:38.711233 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:38.711668 8892 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.711855 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:38.712770 5556 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:38.711337 5548 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.711861 5545 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:38.724529 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:38.674275 7812 raft_consensus.cc:3032] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:38.773849 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.772964 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.666877 8810 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:38.706091 8885 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.689832 8643 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.714996 8924 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:38.690306 8786 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:38.664274 8868 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260807 13:33:38.718320 5620 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:38.720901 5665 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:38.665557 8789 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.641228 8824 consensus_queue.cc:237] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.814548 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.845079 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.846067 5661 raft_consensus.cc:2379] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:38.813141 5659 raft_consensus.cc:2362] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 5. Re-sending same reply.
I20260807 13:33:38.799196 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.773200 7812 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:38.819638 5503 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:38.843291 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 125044us
I20260807 13:33:38.854480 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.855108 5662 raft_consensus.cc:2362] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 6. Re-sending same reply.
I20260807 13:33:38.845394 5656 raft_consensus.cc:2396] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:38.855414 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.714016 8776 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:38.856012 5660 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:38.824968 8653 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:38.686256 8921 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.157s
I20260807 13:33:38.867817 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.874483 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.882158 5499 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:38.874537 5665 raft_consensus.cc:2379] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:38.880180 5666 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:38.881707 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.885347 5663 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:38.844511 8550 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.852566 8548 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:38.890724 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.844707 8827 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260807 13:33:38.906561 8873 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:38.891486 5661 raft_consensus.cc:1261] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:38.894163 7812 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.873090 8934 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 13:33:38.868853 8373 consensus_meta.cc:287] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.888s user 0.012s sys 0.000s
I20260807 13:33:38.920624 8373 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.922721 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.923099 8373 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:38.923471 5656 raft_consensus.cc:2379] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:38.923935 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.924082 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.924577 5656 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260807 13:33:38.926465 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.896637 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:38.928155 5667 raft_consensus.cc:2379] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 2: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:38.897573 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.929708 5660 raft_consensus.cc:2354] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
I20260807 13:33:38.882296 8588 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:38.901518 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:38.932669 5764 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:38.905002 5663 raft_consensus.cc:2396] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:38.881281 5548 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:38.891489 8789 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:38.821678 8810 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:38.909360 8876 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260807 13:33:38.918200 8910 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:38.919162 8926 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:38.871584 5658 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:38.908890 8548 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:38.938987 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.992789 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:38.996995 5658 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 13:33:38.995656 5660 pending_rounds.cc:76] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting all ops after (but not including) 1
I20260807 13:33:39.001727 5660 pending_rounds.cc:97] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:33:39.001991 5660 raft_consensus.cc:2866] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:38.902231 8792 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.011641 5658 raft_consensus.cc:1226] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:38.998577 8548 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:39.023989 5662 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:39.016131 8921 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:39.040534 8921 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.045156 5659 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:33:39.048449 5543 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:39.050159 5661 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
W20260807 13:33:39.046545 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 164476us
I20260807 13:33:38.937907 8588 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.002600 8926 raft_consensus.cc:686] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:39.068646 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:39.069344 5659 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:39.068655 5661 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260807 13:33:39.075522 5499 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:39.026243 8934 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:39.078989 5722 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:39.084511 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 359283us
I20260807 13:33:39.085392 5501 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:39.086869 5722 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:39.079746 8937 log.cc:924] Time spent T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260807 13:33:38.994406 8910 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.093753 5666 raft_consensus.cc:1226] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 1. Current term is 2. Ops: []
I20260807 13:33:39.082640 8888 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:39.096223 5667 raft_consensus.cc:1261] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:39.099491 5501 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:39.081568 8790 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:39.086407 8779 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:39.090566 8653 raft_consensus.cc:686] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:39.110013 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:39.111032 5666 raft_consensus.cc:2379] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:39.036211 8897 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.095794 8776 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:39.115294 5501 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:39.118896 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:39.120625 5771 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:39.101694 8888 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:39.123724 5667 raft_consensus.cc:1261] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:39.102993 8873 raft_consensus.cc:2741] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260807 13:33:39.086578 8889 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260807 13:33:39.104530 8924 raft_consensus.cc:686] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:39.108129 8779 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:39.121315 8888 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:39.158612 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:39.159436 5666 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:39.124936 8776 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:39.109030 8790 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.174248 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:39.175186 5765 raft_consensus.cc:2379] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 4: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:39.175647 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:39.176399 5663 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:39.156172 8779 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:39.197569 8957 consensus_queue.cc:1046] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:39.198635 8957 raft_consensus.cc:3032] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:39.199007 8957 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:39.199797 8957 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.200979 8957 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:39.155165 8926 consensus_queue.cc:237] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.203749 8956 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:39.197569 8897 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:39.205860 8910 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:39.206526 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:39.207638 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:39.208397 5765 raft_consensus.cc:2379] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:39.209378 5765 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:39.210415 8792 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:39.210903 8954 log.cc:924] Time spent T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260807 13:33:39.211798 8588 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:39.212217 8953 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:39.213501 5667 raft_consensus.cc:1261] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:39.159147 8921 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:39.170775 8776 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:39.218089 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:39.223093 5556 raft_consensus.cc:1261] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:39.180310 8810 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:39.224409 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:39.205080 8946 log.cc:924] Time spent T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.114s user 0.001s sys 0.000s
W20260807 13:33:39.211850 8940 log.cc:924] Time spent T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.109s user 0.001s sys 0.000s
I20260807 13:33:39.207638 8930 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 1 FOLLOWER]: Advancing to term 2
I20260807 13:33:39.204255 8956 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.257524 5663 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:39.261570 5666 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:39.262718 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:39.264696 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:39.265172 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 136766us
I20260807 13:33:39.265450 5765 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:39.266673 5659 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:39.279043 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:39.262138 8924 consensus_queue.cc:237] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.280011 5667 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:39.281260 5667 raft_consensus.cc:1261] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:39.283542 5721 leader_election.cc:398] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4.
I20260807 13:33:39.279809 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:39.285336 5659 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:39.286074 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:39.286633 5659 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 7
I20260807 13:33:39.230919 8588 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260807 13:33:39.164261 8960 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260807 13:33:39.293175 5659 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:39.292302 5499 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:39.294854 5659 raft_consensus.cc:1261] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:39.262024 8889 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:39.302341 8889 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.304201 8958 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:39.304756 8958 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.305335 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:39.306658 8947 log.cc:924] Time spent T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.083s user 0.000s sys 0.000s
I20260807 13:33:39.308259 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:39.298197 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:39.298825 8953 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:39.299350 8899 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:39.301357 8864 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:39.306519 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:39.298475 8910 consensus_queue.cc:1035] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:39.309319 5667 raft_consensus.cc:1226] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:39.312697 5721 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:39.313856 5771 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:39.315004 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1145) took 1352 ms. Trace:
I20260807 13:33:39.316500 5764 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:39.320274 5499 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:39.321530 8966 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:39.246995 8653 consensus_queue.cc:237] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.323382 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:39.326817 8958 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:39.330168 8892 consensus_meta.cc:287] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.618s user 0.004s sys 0.007s
I20260807 13:33:39.322803 8790 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:39.401887 5620 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:39.377274 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:39.392463 5548 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:39.401068 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 80890.7us
I20260807 13:33:39.427182 5499 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:39.428289 8970 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:39.428867 8970 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.430383 8966 raft_consensus.cc:686] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:39.431337 8966 consensus_queue.cc:237] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.432125 5765 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
W20260807 13:33:39.438467 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 49459.2us
I20260807 13:33:39.339993 5555 rpcz_store.cc:276] 0807 13:33:37.962466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.051902 (+ 89436us) service_pool.cc:227] Handling call
0807 13:33:38.083444 (+ 31542us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:38.128660 (+ 45216us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:33:38.221174 (+ 92514us) log.cc:842] Serialized 14 byte log entry
0807 13:33:39.143465 (+922291us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b1800049540. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff681ff75bb 00007ff681ffd063 00007ff681ffd57b 00007ff68238088a
0807 13:33:39.250750 (+107285us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:39.261659 (+ 10909us) log.cc:842] Serialized 52 byte log entry
0807 13:33:39.261816 (+ 157us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:39.261848 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:39.261921 (+ 73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:39.309718 (+ 47797us) raft_consensus.cc:1671] finished
0807 13:33:39.314802 (+ 5084us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:39.314947 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":75295,"prepare.queue_time_us":88348,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":70693,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3506,"spinlock_wait_cycles":22586496,"thread_start_us":105315,"threads_started":1,"wal-append.queue_time_us":1057325}
I20260807 13:33:39.435352 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:39.443324 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:39.514405 5620 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:39.518699 5767 raft_consensus.cc:1261] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260807 13:33:39.519225 5767 pending_rounds.cc:76] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 2
I20260807 13:33:39.519608 5767 pending_rounds.cc:97] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260807 13:33:39.519901 5767 raft_consensus.cc:2866] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:39.386785 8921 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:39.532625 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:39.536437 5555 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:39.494611 8873 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:39.494374 8810 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:39.550230 5771 raft_consensus.cc:1261] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:39.548120 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:39.549599 8961 log.cc:924] Time spent T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.287s user 0.000s sys 0.001s
W20260807 13:33:39.558360 8548 consensus_meta.cc:287] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.511s user 0.005s sys 0.005s
I20260807 13:33:39.549297 8957 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:39.565735 5548 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:39.326835 8953 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.559840 8889 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:39.437752 8892 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:39.576333 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 59802.1us
I20260807 13:33:39.375948 8864 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:39.697561 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 188334us
W20260807 13:33:39.587211 8817 consensus_meta.cc:287] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.949s user 0.007s sys 0.004s
I20260807 13:33:39.545878 8921 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.576081 8588 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:39.627328 8975 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:39.615630 8905 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:39.558090 8810 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.644140 8826 consensus_queue.cc:1035] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.108s
I20260807 13:33:39.672406 8548 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.646050 8888 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.947494 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1144) took 1990 ms. Trace:
W20260807 13:33:39.887172 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 81619.2us
I20260807 13:33:39.996206 5554 rpcz_store.cc:276] 0807 13:33:37.956612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:37.956762 (+ 150us) service_pool.cc:227] Handling call
0807 13:33:37.957045 (+ 283us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:38.336128 (+379083us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:38.336168 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:38.380188 (+ 44020us) log.cc:842] Serialized 26 byte log entry
0807 13:33:38.475162 (+ 94974us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:38.475209 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:38.648068 (+172859us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b4800262758. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff68721d7f1 00007ff6872148e7 00007ff68721477a 00007ff68730895f 00007ff687308627 00007ff68731cb2c 00007ff68731cad8 00007ff68731ca58 00007ff68731ca13 00007ff68731bcbc 00007ff68629dbe6
0807 13:33:39.947080 (+1299012us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b54002b1e54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:39.947147 (+ 67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:39.947198 (+ 51us) raft_consensus.cc:1671] finished
0807 13:33:39.947211 (+ 13us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:39.947424 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4046,"raft.queue_time_us":79709,"raft.run_cpu_time_us":3118,"raft.run_wall_time_us":501210,"spinlock_wait_cycles":233793664,"thread_start_us":358648,"threads_started":2,"wal-append.queue_time_us":248752,"wal-append.run_cpu_time_us":1890,"wal-append.run_wall_time_us":1091662}
I20260807 13:33:39.797855 5660 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
W20260807 13:33:40.000285 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 687636us
I20260807 13:33:39.929491 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1168) took 1006 ms. Trace:
I20260807 13:33:39.743885 5658 raft_consensus.cc:1261] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260807 13:33:39.995316 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 428847us
I20260807 13:33:39.695407 8957 raft_consensus.cc:686] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:39.941653 8253 consensus_meta.cc:287] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 1.315s user 0.005s sys 0.005s
I20260807 13:33:39.743183 8817 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:40.021903 8253 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:40.022686 5552 raft_consensus.cc:2396] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260807 13:33:40.016921 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:40.024235 8253 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.024452 5666 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:40.026106 5666 raft_consensus.cc:1261] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:33:39.965104 8965 log.cc:924] Time spent T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.438s user 0.001s sys 0.000s
W20260807 13:33:39.964588 8984 log.cc:924] Time spent T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.420s user 0.001s sys 0.000s
W20260807 13:33:39.990715 8979 log.cc:924] Time spent T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.132s user 0.001s sys 0.000s
I20260807 13:33:40.001016 5656 rpcz_store.cc:276] 0807 13:33:38.923409 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.925248 (+ 1839us) service_pool.cc:227] Handling call
0807 13:33:38.925506 (+ 258us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:38.925810 (+ 304us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:38.925835 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:38.932265 (+ 6430us) log.cc:842] Serialized 26 byte log entry
0807 13:33:39.113377 (+181112us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:39.265860 (+152483us) log.cc:842] Serialized 14 byte log entry
0807 13:33:39.546975 (+281115us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:39.547062 (+ 87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:39.929230 (+382168us) raft_consensus.cc:1671] finished
0807 13:33:39.929257 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:39.929420 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1055,"prepare.queue_time_us":204317,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":41081,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":6612352,"thread_start_us":525121,"threads_started":3,"wal-append.queue_time_us":248376}
I20260807 13:33:40.015970 5721 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:39.935894 8786 consensus_meta.cc:287] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.093s user 0.011s sys 0.000s
I20260807 13:33:40.026611 5553 raft_consensus.cc:1226] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:39.998687 8970 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:39.887032 8971 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:39.942543 8921 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.019305 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:39.998515 8882 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:40.016607 5618 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:39.943774 8892 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.035243 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:39.997457 8956 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:39.938642 8806 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:39.929886 8726 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:40.044947 5666 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:40.045989 5554 raft_consensus.cc:1261] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:40.055572 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:40.042124 8910 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:40.048952 8786 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:40.014964 8905 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:40.078076 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 125361us
I20260807 13:33:40.048838 8971 raft_consensus.cc:686] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:40.081728 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1536) took 1008 ms. Trace:
I20260807 13:33:40.086723 5662 rpcz_store.cc:276] 0807 13:33:39.072970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:39.073142 (+ 172us) service_pool.cc:227] Handling call
0807 13:33:39.073546 (+ 404us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:39.073992 (+ 446us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:39.074033 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:39.074577 (+ 544us) log.cc:842] Serialized 26 byte log entry
0807 13:33:39.170654 (+ 96077us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:39.170708 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:39.170791 (+ 83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:40.081478 (+910687us) raft_consensus.cc:1671] finished
0807 13:33:40.081499 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:40.081644 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4449,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4862,"thread_start_us":75315,"threads_started":1,"wal-append.queue_time_us":251527}
W20260807 13:33:40.072592 8779 consensus_meta.cc:287] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.869s user 0.012s sys 0.000s
I20260807 13:33:40.060019 8882 raft_consensus.cc:686] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:40.137598 5554 raft_consensus.cc:1261] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260807 13:33:40.165112 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 76711.9us
I20260807 13:33:40.240592 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1175) took 1146 ms. Trace:
I20260807 13:33:40.248759 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:40.254945 5765 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:40.248858 5661 rpcz_store.cc:276] 0807 13:33:39.093870 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:39.106955 (+ 13085us) service_pool.cc:227] Handling call
0807 13:33:39.127070 (+ 20115us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:39.144793 (+ 17723us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:39.144822 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:39.154253 (+ 9431us) log.cc:842] Serialized 26 byte log entry
0807 13:33:39.435490 (+281237us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:39.435524 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:39.435587 (+ 63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:40.240382 (+804795us) raft_consensus.cc:1671] finished
0807 13:33:40.240402 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:40.240532 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5222,"raft.queue_time_us":17521,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":12197,"thread_start_us":221362,"threads_started":1,"wal-append.queue_time_us":470160}
W20260807 13:33:40.261956 8987 log.cc:924] Time spent T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.198s user 0.000s sys 0.000s
W20260807 13:33:40.263064 8907 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s user 0.013s sys 0.004s
W20260807 13:33:40.263476 8907 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s user 0.014s sys 0.004s
I20260807 13:33:40.264606 9005 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:40.265232 9005 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:39.998078 8975 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:40.240605 8967 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:40.275219 8967 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:40.061508 8806 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:40.278508 8971 consensus_queue.cc:237] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:40.281872 8806 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.290937 8864 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.064921 8726 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:40.297668 8726 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.075510 8910 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:40.091977 8957 consensus_queue.cc:237] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:40.480446 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 441751us
I20260807 13:33:40.516052 5722 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:40.233847 8779 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:40.512971 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 435060us
I20260807 13:33:40.894212 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:40.827436 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:40.894759 5721 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:40.602834 5666 consensus_meta.cc:287] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.533s user 0.007s sys 0.003s
I20260807 13:33:40.400673 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1542) took 1115 ms. Trace:
I20260807 13:33:40.649523 5765 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:40.557484 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:40.522989 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 468136us
I20260807 13:33:40.233330 8892 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:40.632732 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:40.749212 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 233258us
I20260807 13:33:40.634397 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:40.897280 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 264251us
I20260807 13:33:40.910188 5661 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:40.896938 5659 rpcz_store.cc:276] 0807 13:33:39.284955 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:39.295537 (+ 10582us) service_pool.cc:227] Handling call
0807 13:33:39.316478 (+ 20941us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:39.333359 (+ 16881us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:39.333402 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:39.385031 (+ 51629us) log.cc:842] Serialized 26 byte log entry
0807 13:33:40.007822 (+622791us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:40.007873 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:40.007961 (+ 88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:40.400391 (+392430us) raft_consensus.cc:1671] finished
0807 13:33:40.400421 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:40.400609 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":16785,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":51958,"thread_start_us":92188,"threads_started":1,"wal-append.queue_time_us":611400}
I20260807 13:33:40.896960 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1551) took 1041 ms. Trace:
I20260807 13:33:40.908859 5618 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:40.907745 5764 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:40.911608 5666 rpcz_store.cc:276] 0807 13:33:39.870048 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:40.027760 (+157712us) service_pool.cc:227] Handling call
0807 13:33:40.044811 (+ 17051us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:40.896643 (+851832us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:40.896671 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:40.896710 (+ 39us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:40.896746 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:40.896799 (+ 53us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:40.896907 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:40.238850 8953 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.926880 5618 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:40.303001 8548 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.781957 8967 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:40.939534 9014 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:40.939698 8892 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:40.940081 9014 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:40.914091 8868 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:40.940457 9014 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:40.941017 8868 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:40.733100 8959 log.cc:924] Time spent T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 1.568s user 0.006s sys 0.001s
I20260807 13:33:40.456427 8864 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:40.847718 8905 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:40.896071 9021 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:40.334410 8984 log.cc:924] Time spent T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.204s user 0.001s sys 0.000s
W20260807 13:33:40.455557 8776 consensus_meta.cc:287] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.205s user 0.011s sys 0.001s
W20260807 13:33:40.570348 8588 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.505s user 0.002s sys 0.013s
W20260807 13:33:40.949959 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 55284.9us
I20260807 13:33:40.965677 5618 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:40.913762 8876 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:40.895689 8611 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:40.945453 8466 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:40.902805 8817 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:40.940493 8895 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:40.969794 8588 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.910s user 0.009s sys 0.029s
I20260807 13:33:40.260845 8988 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:40.431113 8904 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:40.274089 8975 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:40.240979 8870 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:40.895485 5501 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.195:43427 timed out after 1.744s (SENT) [suppressed 34 similar messages]
I20260807 13:33:40.309028 8829 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:40.299476 8810 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.946064 8888 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:40.946978 9021 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:40.992125 5620 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:40.969990 5721 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:40.952272 8930 consensus_meta.cc:287] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 1.691s user 0.008s sys 0.007s
I20260807 13:33:40.709971 8994 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:40.943995 8779 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:40.417279 8990 consensus_queue.cc:1035] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.733s
I20260807 13:33:41.008930 5661 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 7.
I20260807 13:33:41.039186 5556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1164) took 1816 ms. Trace:
W20260807 13:33:41.039759 5500 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.087s user 0.010s sys 0.033s
I20260807 13:33:40.944365 8864 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:41.044441 5499 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.302s user 0.025s sys 0.034s
I20260807 13:33:40.940451 8892 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:41.047878 5555 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s user 0.018s sys 0.039s
I20260807 13:33:40.418145 8882 consensus_queue.cc:237] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:41.066167 5555 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s user 0.020s sys 0.039s
I20260807 13:33:40.989329 8548 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 13:33:41.061040 5500 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.154s user 0.010s sys 0.033s
W20260807 13:33:41.048462 8786 consensus_meta.cc:287] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.966s user 0.014s sys 0.000s
I20260807 13:33:41.001184 8588 raft_consensus.cc:686] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:41.063685 6638 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.509s user 0.000s sys 0.005s
W20260807 13:33:41.065228 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 95301.4us
W20260807 13:33:41.076390 6638 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.548s user 0.000s sys 0.006s
I20260807 13:33:41.077229 5721 leader_election.cc:398] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
I20260807 13:33:41.077670 5721 leader_election.cc:401] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260807 13:33:41.061304 5499 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.334s user 0.026s sys 0.035s
I20260807 13:33:41.064666 8930 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 13:33:41.060883 5556 rpcz_store.cc:276] 0807 13:33:39.223149 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:39.263720 (+ 40571us) service_pool.cc:227] Handling call
0807 13:33:39.264057 (+ 337us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:39.290379 (+ 26322us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:39.290410 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:39.298900 (+ 8490us) log.cc:842] Serialized 52 byte log entry
0807 13:33:39.383875 (+ 84975us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:39.492604 (+108729us) log.cc:842] Serialized 14 byte log entry
0807 13:33:39.757445 (+264841us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:39.757539 (+ 94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:41.038962 (+1281423us) raft_consensus.cc:1671] finished
0807 13:33:41.038983 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:41.039133 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17032,"prepare.queue_time_us":108600,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":184079,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":24479,"spinlock_wait_cycles":1408,"thread_start_us":315690,"threads_started":2,"wal-append.queue_time_us":245374}
I20260807 13:33:41.070871 8779 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:40.966552 8776 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.001493 8355 raft_consensus.cc:3032] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:41.069861 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1170) took 1760 ms. Trace:
W20260807 13:33:41.076354 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 84341.8us
I20260807 13:33:41.093240 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:41.069509 8975 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:40.995905 8876 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:40.998849 8611 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:41.095623 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 158595us
I20260807 13:33:41.003270 8817 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:41.059505 9025 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.004343 8895 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:41.045193 8967 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.042s
I20260807 13:33:41.068392 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:41.047494 8870 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.046180 8904 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.160482 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:41.275981 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1158) took 2584 ms. Trace:
I20260807 13:33:41.097707 5555 rpcz_store.cc:276] 0807 13:33:39.309472 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:40.072892 (+763420us) service_pool.cc:227] Handling call
0807 13:33:40.073245 (+ 353us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:40.073951 (+ 706us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:33:40.449149 (+375198us) log.cc:842] Serialized 14 byte log entry
0807 13:33:41.069485 (+620336us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:41.069534 (+ 49us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:41.069598 (+ 64us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:41.069661 (+ 63us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:41.069797 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39615,"prepare.queue_time_us":374801,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":4248,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":14949,"thread_start_us":619855,"threads_started":1}
I20260807 13:33:41.161194 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:41.175009 5621 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.965s user 0.006s sys 0.027s
W20260807 13:33:41.370572 5621 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.368s user 0.009s sys 0.030s
W20260807 13:33:41.301090 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 405819us
I20260807 13:33:41.324066 5499 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:41.099344 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:41.366466 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 289401us
I20260807 13:33:41.206313 5620 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:41.374128 5721 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:41.301507 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 330552us
I20260807 13:33:41.377089 5618 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:41.369132 5543 rpcz_store.cc:276] 0807 13:33:38.691897 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.810293 (+118396us) service_pool.cc:227] Handling call
0807 13:33:38.826612 (+ 16319us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:39.048847 (+222235us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:41.275646 (+2226799us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400222c54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:41.275882 (+ 236us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":509777280}
I20260807 13:33:41.071852 8810 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:33:41.068392 9020 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.390913 5659 raft_consensus.cc:2379] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:33:41.390601 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 66727.3us
I20260807 13:33:41.366267 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:41.397119 5658 raft_consensus.cc:2354] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:33:41.072479 8464 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:41.072309 9015 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:41.099361 5666 raft_consensus.cc:2379] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:41.452970 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:41.075609 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:41.160660 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:41.086020 8953 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:41.320254 9005 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:41.144150 8905 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.459396 5667 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:41.091408 8355 raft_consensus.cc:729] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:41.466301 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:41.251825 8892 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:41.217001 8548 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:41.388477 8827 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.389257 6636 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:41.086946 8786 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:41.502635 5771 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:41.107010 8779 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:41.249305 9032 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
I20260807 13:33:41.321560 8864 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:41.355194 9028 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.162s
I20260807 13:33:41.142234 9034 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:41.151129 9035 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:41.142968 8927 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.226468 8868 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:41.432542 8888 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:41.477975 5661 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:41.458972 9015 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:41.452662 8829 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260807 13:33:41.059803 8988 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:41.507185 8882 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.483667 8905 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.068491 8994 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:41.516422 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 146182us
I20260807 13:33:41.475143 6680 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:41.479617 8870 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:41.523046 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 149037us
I20260807 13:33:41.149895 8975 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:41.314268 9027 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:41.486464 9049 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.487703 8892 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:41.250541 8588 consensus_queue.cc:237] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.544483 5771 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 7.
I20260807 13:33:41.475602 8953 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:41.498564 8548 raft_consensus.cc:686] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:41.326884 9014 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.515247 8776 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:41.556666 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 103588us
W20260807 13:33:41.511037 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 422892us
I20260807 13:33:41.522203 9021 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:41.536578 8967 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:41.496224 8827 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.453866 9020 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.412871 9025 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.538540 8355 consensus_queue.cc:260] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.885650 5721 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:41.746294 5661 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
W20260807 13:33:41.845366 5552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 1130) took 3129 ms (client timeout 1560 ms). Trace:
I20260807 13:33:41.555490 9047 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:41.887069 5552 rpcz_store.cc:269] 0807 13:33:38.679408 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.679526 (+ 118us) service_pool.cc:227] Handling call
0807 13:33:41.808483 (+3128957us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002e6654. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:41.808639 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3086455552}
I20260807 13:33:41.888190 9047 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:41.865504 5372 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet fc6f41d0f11d4c6295bae40c23631a4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 14f62bf285c448b9b7a21fabd7a5f0bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
W20260807 13:33:41.658587 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 281641us
I20260807 13:33:41.806620 8934 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:41.890872 5618 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:41.891642 9047 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:41.807132 8862 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 3.325s user 0.014s sys 0.035s
W20260807 13:33:41.892709 8862 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 3.760s user 0.015s sys 0.042s
I20260807 13:33:41.831502 8904 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:41.890962 8934 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:41.540048 8786 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:41.561142 8864 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:33:41.805045 8810 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:41.558822 9034 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:41.914755 5721 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:41.921772 5767 raft_consensus.cc:2379] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:41.921934 5721 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:41.555015 8239 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.555581 8888 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:41.555115 8877 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:41.923934 5762 raft_consensus.cc:2396] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260807 13:33:41.782096 9005 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.928786 5721 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:41.880972 8895 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:41.886088 8892 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:41.932109 9034 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:41.946094 8892 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:41.907593 9028 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.904655 8829 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:41.930812 8810 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.932333 8975 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:41.595100 8817 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:41.940008 5721 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:41.937721 9047 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:33:41.936512 8776 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:41.932189 8953 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:41.804160 8988 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:41.972865 5766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1250) took 3342 ms. Trace:
I20260807 13:33:41.599768 8611 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:41.906487 9021 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:41.802273 9051 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:41.973259 5766 rpcz_store.cc:276] 0807 13:33:38.630306 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.630436 (+ 130us) service_pool.cc:227] Handling call
0807 13:33:38.630769 (+ 333us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:38.656787 (+ 26018us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:38.656817 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:38.657211 (+ 394us) log.cc:842] Serialized 26 byte log entry
0807 13:33:38.721882 (+ 64671us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:38.721916 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:41.963677 (+3241761us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b540020a8d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:41.963744 (+ 67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:41.963810 (+ 66us) raft_consensus.cc:1671] finished
0807 13:33:41.963840 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:41.972784 (+ 8944us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2327,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2220,"spinlock_wait_cycles":59094784,"thread_start_us":64239,"threads_started":1,"wal-append.queue_time_us":215769,"wal-append.run_cpu_time_us":1793,"wal-append.run_wall_time_us":1031021}
I20260807 13:33:41.933197 8888 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:41.961493 5721 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:41.558537 9015 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:41.926182 8904 consensus_queue.cc:1046] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260807 13:33:41.917035 8876 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:41.933995 8864 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:41.898883 8967 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:41.930850 9038 log.cc:924] Time spent T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.441s user 0.000s sys 0.001s
I20260807 13:33:41.564483 8882 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.555292 8927 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.982599 8988 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:41.941721 8786 consensus_queue.cc:1035] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260807 13:33:41.901501 9027 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:41.971370 8975 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:41.937157 8239 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.962512 8779 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:41.945680 8877 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:42.002526 9061 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:33:42.008661 9058 log.cc:924] Time spent T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.139s user 0.000s sys 0.001s
I20260807 13:33:41.947101 9005 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:42.035240 5763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1493) took 3631 ms (client timeout 1744 ms). Trace:
W20260807 13:33:42.036501 5763 rpcz_store.cc:269] 0807 13:33:38.404153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:42.020757 (+3616604us) service_pool.cc:214] Skipping call since client already timed out
0807 13:33:42.035149 (+ 14392us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:33:41.957155 8829 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.937096 9032 consensus_queue.cc:1046] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260807 13:33:41.982914 9047 raft_consensus.cc:686] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:41.980583 8776 raft_consensus.cc:686] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:41.900928 9049 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.973348 8548 consensus_queue.cc:237] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.957751 9028 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.981659 9021 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:41.993283 8611 consensus_queue.cc:1035] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260807 13:33:42.012934 9051 raft_consensus.cc:686] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:42.011816 8864 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.051249 8975 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:42.047099 9020 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:42.047472 8779 consensus_queue.cc:1035] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260807 13:33:41.556818 9035 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.084033 8892 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.140396 8994 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.097528 9032 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:42.100656 9014 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:42.094480 9041 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:42.160306 9030 log.cc:924] Time spent T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.421s user 0.000s sys 0.001s
I20260807 13:33:42.162489 8239 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:42.115690 8827 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.124869 8786 raft_consensus.cc:3032] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 13:33:42.132601 8905 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:42.175712 5767 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32950 (request call id 1271) took 1618 ms (client timeout 1559 ms). Trace:
I20260807 13:33:42.131987 8882 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:42.181914 5767 rpcz_store.cc:269] 0807 13:33:40.557071 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:40.557195 (+ 124us) service_pool.cc:227] Handling call
0807 13:33:42.175447 (+1618252us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002715d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:42.175601 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2325683072}
I20260807 13:33:42.186297 9027 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:42.189535 9035 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:42.164551 9034 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:42.225340 8927 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.228329 8829 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.229782 9005 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.168390 8988 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:42.176568 6688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57224 (request call id 200) took 3312 ms. Trace:
I20260807 13:33:42.294409 8866 raft_consensus.cc:3032] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:42.306515 8866 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:42.179541 8786 raft_consensus.cc:729] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:42.309223 8786 consensus_queue.cc:260] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.181344 8994 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:42.304975 9018 log.cc:924] Time spent T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 1.050s user 0.003s sys 0.006s
I20260807 13:33:42.170572 9051 consensus_queue.cc:237] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:42.322989 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1545) took 2614 ms. Trace:
I20260807 13:33:42.324349 8994 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.323532 5663 rpcz_store.cc:276] 0807 13:33:39.708389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:39.708675 (+ 286us) service_pool.cc:227] Handling call
0807 13:33:39.750224 (+ 41549us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:40.002192 (+251968us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:40.002230 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:40.017412 (+ 15182us) log.cc:842] Serialized 26 byte log entry
0807 13:33:40.234423 (+217011us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:40.234480 (+ 57us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:40.234589 (+ 109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:42.298736 (+2064147us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:42.322476 (+ 23740us) raft_consensus.cc:1671] finished
0807 13:33:42.322506 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:42.322837 (+ 331us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":262192,"raft.queue_time_us":303070,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":17854,"spinlock_wait_cycles":75654016,"thread_start_us":212696,"threads_started":1,"wal-append.queue_time_us":1157213}
I20260807 13:33:42.328192 8994 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.329072 8994 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:42.330528 8932 log.cc:924] Time spent T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 3.283s user 0.017s sys 0.048s
I20260807 13:33:42.282337 8810 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.165952 9047 consensus_queue.cc:237] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.167325 8776 consensus_queue.cc:237] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.300129 8827 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:42.182803 9041 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.316277 8892 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.566551 8927 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:42.320799 8967 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:42.341650 9028 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.354562 8786 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 1 FOLLOWER]: Advancing to term 2
W20260807 13:33:42.775894 6685 consensus_meta.cc:287] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 1.321s user 0.011s sys 0.003s
I20260807 13:33:42.329772 8994 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.546378 8874 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:42.551538 8810 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:42.858942 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 118) took 4177 ms. Trace:
I20260807 13:33:42.859578 5545 rpcz_store.cc:276] 0807 13:33:38.681427 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.739810 (+ 58383us) service_pool.cc:227] Handling call
0807 13:33:38.824783 (+ 84973us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:38.936006 (+111223us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:38.936034 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:38.936070 (+ 36us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:38.936102 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:42.858660 (+3922558us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002e7554. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:42.858725 (+ 65us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:42.858873 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":255368064}
I20260807 13:33:42.860778 9063 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:42.861550 9063 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:42.809078 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.347s user 0.058s sys 0.099s
W20260807 13:33:42.864475 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.403s user 0.058s sys 0.099s
I20260807 13:33:42.762075 9021 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:42.864806 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 1.65848e+06us
I20260807 13:33:42.641363 8877 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:42.312945 6688 rpcz_store.cc:276] 0807 13:33:38.860970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:42.017099 (+3156129us) service_pool.cc:227] Handling call
0807 13:33:42.076965 (+ 59866us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:42.110597 (+ 33632us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:42.115975 (+ 5378us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:42.125198 (+ 9223us) raft_consensus.cc:1631] Marking committed up to 8
0807 13:33:42.138001 (+ 12803us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:42.150755 (+ 12754us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:42.173066 (+ 22311us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:42.803126 8943 log.cc:924] Time spent T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.086s user 0.000s sys 0.000s
I20260807 13:33:42.726627 8827 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.801211 8874 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:42.801445 9049 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:42.802207 6685 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:42.762439 8927 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.865839 8864 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.907066 9057 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:42.916460 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.934325 5767 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:42.917424 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.935501 5763 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:42.936826 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.929371 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.930627 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.931470 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.939706 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.939232 5769 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:42.942049 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.944427 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1131) took 4264 ms. Trace:
I20260807 13:33:42.945705 5769 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:42.929751 8827 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.949851 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.944794 5544 rpcz_store.cc:276] 0807 13:33:38.679683 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.679797 (+ 114us) service_pool.cc:227] Handling call
0807 13:33:38.680106 (+ 309us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:38.693478 (+ 13372us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:38.693506 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:38.714825 (+ 21319us) log.cc:842] Serialized 26 byte log entry
0807 13:33:38.859209 (+144384us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:38.891813 (+ 32604us) log.cc:842] Serialized 14 byte log entry
0807 13:33:39.121983 (+230170us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:39.122092 (+ 109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:41.994702 (+2872610us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18003e2e40. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:33:42.944081 (+949379us) raft_consensus.cc:1671] finished
0807 13:33:42.944191 (+ 110us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:42.944322 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9430,"prepare.queue_time_us":31203,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":53260,"raft.run_cpu_time_us":9683,"raft.run_wall_time_us":109762,"spinlock_wait_cycles":5257472,"thread_start_us":283987,"threads_started":2,"wal-append.queue_time_us":272917}
I20260807 13:33:42.950603 5763 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:42.953867 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:42.954615 5767 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:42.866367 8810 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:42.956629 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.958163 5764 raft_consensus.cc:2396] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:42.962777 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1544) took 3677 ms. Trace:
I20260807 13:33:42.962677 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:42.963392 5764 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:42.342454 8988 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:42.946795 6685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37838 (request call id 129) took 1918 ms (client timeout 1670 ms). Trace:
I20260807 13:33:42.963151 5660 rpcz_store.cc:276] 0807 13:33:39.285471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:39.376477 (+ 91006us) service_pool.cc:227] Handling call
0807 13:33:39.513376 (+136899us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:40.015336 (+501960us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:42.962571 (+2947235us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54001b94d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:42.962724 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":549850496}
I20260807 13:33:42.987421 8927 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.989486 8810 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:42.995834 9012 log.cc:924] Time spent T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 2.056s user 0.009s sys 0.034s
W20260807 13:33:42.997382 5762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1494) took 4592 ms (client timeout 2445 ms). Trace:
W20260807 13:33:42.997977 5762 rpcz_store.cc:269] 0807 13:33:38.405365 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.405582 (+ 217us) service_pool.cc:227] Handling call
0807 13:33:41.452788 (+3047206us) spinlock_profiling.cc:243] Waited 875 us on lock 0x7b5800004298. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:42.997072 (+1544284us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b540036c9d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:42.997269 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1082861568}
I20260807 13:33:42.993644 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.005407 9064 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:43.007874 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1163) took 3785 ms. Trace:
I20260807 13:33:43.008334 5553 rpcz_store.cc:276] 0807 13:33:39.222881 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:39.223037 (+ 156us) service_pool.cc:227] Handling call
0807 13:33:39.223287 (+ 250us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:40.031160 (+807873us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:43.007599 (+2976439us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400334fd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:43.007802 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1847002368}
I20260807 13:33:42.959159 9063 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:43.000151 9041 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:42.953123 9057 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.020707 8885 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:43.022934 8430 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:43.023366 8885 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:43.024072 8430 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:43.038340 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.039113 5658 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
W20260807 13:33:43.042021 5725 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.524s user 0.039s sys 0.098s
I20260807 13:33:43.042380 5663 raft_consensus.cc:1261] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:43.043372 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:43.042399 5725 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.623s user 0.040s sys 0.098s
I20260807 13:33:43.044324 5666 raft_consensus.cc:2396] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:43.041726 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.047027 5660 raft_consensus.cc:2396] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260807 13:33:42.976198 6685 rpcz_store.cc:269] 0807 13:33:40.995334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:40.999022 (+ 3688us) service_pool.cc:227] Handling call
0807 13:33:42.913456 (+1914434us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:43.030043 8885 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:43.061451 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.068713 5660 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:43.059855 5725 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:43.063813 8912 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:43.064275 8994 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:43.049209 9041 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:43.066972 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:43.091542 8973 log.cc:924] Time spent T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 3.653s user 0.008s sys 0.030s
I20260807 13:33:43.060743 8373 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:43.093226 8373 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:43.094807 8888 consensus_meta.cc:287] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 1.100s user 0.014s sys 0.000s
I20260807 13:33:43.095316 8888 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.096452 8373 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:43.098273 8355 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:43.074623 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:43.102828 6691 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:43.075445 9049 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:43.109078 9049 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:43.109740 9049 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:43.076064 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:43.029874 8430 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:43.084374 5767 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:43.027642 9057 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:43.025180 9064 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.195695 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1167) took 4268 ms. Trace:
I20260807 13:33:43.196127 5665 rpcz_store.cc:276] 0807 13:33:38.923151 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.924773 (+ 1622us) service_pool.cc:227] Handling call
0807 13:33:38.925066 (+ 293us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:38.925356 (+ 290us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:38.925380 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:38.925788 (+ 408us) log.cc:842] Serialized 26 byte log entry
0807 13:33:39.372571 (+446783us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:39.372625 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:39.372717 (+ 92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:43.079862 (+3707145us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:43.092828 (+ 12966us) raft_consensus.cc:1671] finished
0807 13:33:43.092849 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:43.191797 (+ 98948us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":900,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4114,"spinlock_wait_cycles":197595520,"thread_start_us":446466,"threads_started":1,"wal-append.queue_time_us":501218}
I20260807 13:33:43.127228 9041 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.171063 8912 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:43.211413 8912 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:43.216578 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.217365 5666 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:43.142272 6688 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:43.181278 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:43.176856 9064 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:43.228283 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:43.230175 5663 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 13:33:43.222795 8934 consensus_meta.cc:287] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 1.299s user 0.011s sys 0.006s
I20260807 13:33:43.234424 9041 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:43.241174 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.241734 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:43.248730 8964 log.cc:924] Time spent T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 3.813s user 0.026s sys 0.058s
I20260807 13:33:43.250550 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.251140 5659 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:43.252308 5665 raft_consensus.cc:2396] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260807 13:33:43.258023 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.228698 8988 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:43.262740 9007 log.cc:924] Time spent T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 2.115s user 0.013s sys 0.010s
I20260807 13:33:43.258836 5659 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:43.265486 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.266716 8888 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:43.267228 9025 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:43.267402 5616 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.725s user 0.042s sys 0.066s
W20260807 13:33:43.267784 5616 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.806s user 0.042s sys 0.067s
I20260807 13:33:43.271055 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:43.248756 9015 consensus_meta.cc:287] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.255s user 0.016s sys 0.000s
I20260807 13:33:43.280483 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.287040 5499 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:43.287750 5659 raft_consensus.cc:2379] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:43.288266 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.289489 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:43.241925 8934 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.292434 5659 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 7.
I20260807 13:33:43.298883 8855 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:33:43.313973 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.314787 5763 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:43.276645 9025 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:43.300110 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.317752 5769 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:43.300426 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.319146 5764 raft_consensus.cc:2379] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:43.301083 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.302644 5765 raft_consensus.cc:1226] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:43.321723 5761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1249) took 5018 ms. Trace:
I20260807 13:33:43.310084 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:43.299433 9063 consensus_queue.cc:1035] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:43.317157 8855 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:43.363960 8855 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:43.352210 9025 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:43.354209 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.354662 8445 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:43.355392 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:43.358397 5722 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.835s user 0.063s sys 0.143s
I20260807 13:33:43.358520 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.360097 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.385685 5659 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:43.385700 5722 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.862s user 0.063s sys 0.143s
W20260807 13:33:43.361663 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 49585.2us
I20260807 13:33:43.386634 5620 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:43.375341 9056 log.cc:924] Time spent T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159: Append to log took a long time: real 1.776s user 0.010s sys 0.034s
I20260807 13:33:43.377245 8910 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:43.380410 8874 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.384354 5769 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:43.361081 5499 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:43.387884 5620 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:43.359616 8975 consensus_meta.cc:287] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.235s user 0.006s sys 0.009s
I20260807 13:33:43.395592 8975 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:43.395867 5499 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:43.385416 8445 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:43.394843 9064 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:43.322209 5761 rpcz_store.cc:276] 0807 13:33:38.302844 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.316081 (+ 13237us) service_pool.cc:227] Handling call
0807 13:33:38.316501 (+ 420us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:38.409131 (+ 92630us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:38.409171 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:39.045691 (+636520us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b2c00088b18. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff680d59e11 00007ff680d69442 00007ff6823b1c11 00007ff68237658a 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772
0807 13:33:39.046241 (+ 550us) log.cc:842] Serialized 52 byte log entry
0807 13:33:39.162411 (+116170us) raft_consensus.cc:1631] Marking committed up to 1
0807 13:33:39.162447 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:39.162509 (+ 62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:43.240105 (+4077596us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:43.321468 (+ 81363us) raft_consensus.cc:1671] finished
0807 13:33:43.321496 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:43.321651 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":51,"raft.queue_time_us":248468,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":11119,"spinlock_wait_cycles":30388480,"thread_start_us":167062,"threads_started":2,"wal-append.queue_time_us":235596}
W20260807 13:33:43.385630 9018 log.cc:924] Time spent T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.082s user 0.000s sys 0.000s
I20260807 13:33:43.396582 8445 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:43.398412 5620 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:43.303884 8888 consensus_queue.cc:1046] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260807 13:33:43.400864 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:43.402300 5659 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:43.396638 9064 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:43.403895 9000 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:43.404454 9000 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:43.405015 9000 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:43.277333 9015 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.391827 8430 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:43.414016 5620 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:43.417654 9019 log.cc:924] Time spent T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 2.322s user 0.008s sys 0.018s
I20260807 13:33:43.429764 9046 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:43.430393 9046 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:43.431043 8874 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:43.407752 9064 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:43.409278 8953 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:43.421411 8430 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:43.447885 8430 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:43.424463 8888 consensus_queue.cc:1225] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 0b9aca0aafaa43e7998ee8f3e59627e0 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:33:43.430946 9046 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:43.444290 5620 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:43.426934 8827 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:43.420714 8988 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260807 13:33:43.531738 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 87537.7us
I20260807 13:33:43.445868 8953 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:43.538937 5620 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:43.540861 5620 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:43.533387 9013 log.cc:924] Time spent T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 2.542s user 0.032s sys 0.067s
I20260807 13:33:43.522337 8827 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:43.543918 8827 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:43.548372 5725 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:43.549443 5725 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:43.406657 8899 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
I20260807 13:33:43.550372 8975 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:43.550843 8975 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:43.551390 8975 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:43.536325 8855 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.554361 8910 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:43.543901 5620 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:43.556674 7812 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:43.407255 5659 raft_consensus.cc:1226] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:43.557135 8910 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:43.566998 8910 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:43.574880 8994 raft_consensus.cc:2781] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:43.577780 5620 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:43.590246 8810 consensus_queue.cc:1046] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:43.590876 8994 raft_consensus.cc:686] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:43.594780 5771 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47820 (request call id 165) took 3537 ms (client timeout 1535 ms). Trace:
W20260807 13:33:43.595412 5771 rpcz_store.cc:269] 0807 13:33:40.038257 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:40.038949 (+ 692us) service_pool.cc:227] Handling call
0807 13:33:43.575927 (+3536978us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400212354. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:43.576033 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3320775936}
I20260807 13:33:43.596139 8994 consensus_queue.cc:237] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.557942 8953 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:43.602753 5499 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:43.605353 5761 raft_consensus.cc:1261] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260807 13:33:43.606455 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:43.607070 5665 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:43.608597 8907 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:43.600231 8934 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:43.724782 5665 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:43.750196 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:43.751220 5665 raft_consensus.cc:2379] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:43.616111 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:43.731428 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:43.754750 5769 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:43.761626 5499 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:43.761869 5620 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:43.615867 5770 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260807 13:33:43.764396 5770 pending_rounds.cc:76] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 2
I20260807 13:33:43.764791 5770 pending_rounds.cc:97] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260807 13:33:43.765750 5770 raft_consensus.cc:2866] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 13:33:43.677161 6636 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.790s user 0.020s sys 0.036s
W20260807 13:33:43.769691 6636 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.882s user 0.020s sys 0.037s
I20260807 13:33:43.591868 8445 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:43.664705 9025 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:43.650545 9026 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:43.700786 9015 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:43.780627 8355 consensus_meta.cc:287] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.682s user 0.013s sys 0.002s
W20260807 13:33:43.819650 9049 consensus_meta.cc:287] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.670s user 0.009s sys 0.005s
I20260807 13:33:43.823258 8934 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:43.642198 8899 consensus_queue.cc:1046] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.234s
I20260807 13:33:43.670012 8643 consensus_queue.cc:1035] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.206s
I20260807 13:33:43.840761 8810 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:43.648303 8827 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:43.873075 5771 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:43.900146 5771 raft_consensus.cc:595] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:43.706339 8866 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.901614 8855 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:43.905210 8445 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:43.616073 8829 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:43.705428 8907 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:43.902042 8897 raft_consensus.cc:3032] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:43.886940 9026 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:43.896778 8810 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:43.883941 9049 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:43.943635 5771 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:43.954555 5771 raft_consensus.cc:595] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:43.954910 5771 raft_consensus.cc:603] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:43.902253 8934 raft_consensus.cc:686] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:43.930647 8866 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:43.934860 8786 consensus_meta.cc:287] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 1.133s user 0.014s sys 0.000s
I20260807 13:33:43.955500 6636 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:43.928256 8897 raft_consensus.cc:729] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:43.942234 9026 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:43.950798 8829 raft_consensus.cc:686] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:43.984645 5770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1495) took 5309 ms. Trace:
I20260807 13:33:44.022150 5763 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:43.954016 8810 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:43.936750 8827 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:44.024397 5766 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
W20260807 13:33:43.969969 8430 consensus_meta.cc:287] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.521s user 0.009s sys 0.001s
W20260807 13:33:44.029378 8664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.137s user 0.018s sys 0.026s
I20260807 13:33:43.958287 9016 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:44.034776 5770 rpcz_store.cc:276] 0807 13:33:38.675046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:38.675203 (+ 157us) service_pool.cc:227] Handling call
0807 13:33:38.675504 (+ 301us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:43.822209 (+5146705us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:43.984000 (+161791us) spinlock_profiling.cc:243] Waited 4.94 s on lock 0x7b540036c4d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:43.984220 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11360969472}
I20260807 13:33:44.165722 9015 consensus_queue.cc:1046] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260807 13:33:44.177457 5503 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.107s user 0.080s sys 0.127s
I20260807 13:33:44.175886 9071 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:44.037067 8253 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:44.189131 5766 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:44.123574 5620 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:44.030946 8881 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:44.031288 8355 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:44.176750 8440 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.109s user 0.053s sys 0.161s
I20260807 13:33:44.119020 8430 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:44.162366 5721 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.181s user 0.014s sys 0.019s
I20260807 13:33:44.190274 8934 consensus_queue.cc:237] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:44.374400 5503 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.304s user 0.097s sys 0.143s
W20260807 13:33:44.374962 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 2.30473e+06us
W20260807 13:33:44.378077 9000 consensus_meta.cc:287] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.972s user 0.010s sys 0.005s
I20260807 13:33:44.374953 8253 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:44.378443 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 254959us
W20260807 13:33:44.360908 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 76545.6us
W20260807 13:33:44.381390 5721 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.400s user 0.018s sys 0.019s
I20260807 13:33:44.380672 5766 raft_consensus.cc:595] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:44.237006 8548 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.170s user 0.010s sys 0.027s
I20260807 13:33:44.378958 8253 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:44.378607 9000 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:44.378304 8881 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:44.248134 8904 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.236s user 0.005s sys 0.021s
I20260807 13:33:44.368081 8897 consensus_queue.cc:260] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:44.332630 8829 consensus_queue.cc:237] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:44.389415 9016 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:44.377720 9071 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:44.819051 8924 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.851s user 0.053s sys 0.154s
W20260807 13:33:45.016355 8924 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.049s user 0.055s sys 0.175s
I20260807 13:33:44.397811 8355 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:44.749930 5621 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.558s user 0.010s sys 0.032s
W20260807 13:33:45.020042 5621 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.840s user 0.012s sys 0.037s
I20260807 13:33:44.402047 9049 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:44.380383 8440 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.318s user 0.054s sys 0.166s
I20260807 13:33:44.449415 5666 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
W20260807 13:33:45.020721 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 3.05906e+06us
W20260807 13:33:44.809732 5501 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.086s user 0.025s sys 0.038s
W20260807 13:33:45.028872 5501 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.306s user 0.026s sys 0.041s
I20260807 13:33:44.986455 5763 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:45.030190 5721 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:44.953230 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:45.034271 5770 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:44.382884 8664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.482s user 0.018s sys 0.028s
W20260807 13:33:45.157675 5666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1579) took 1909 ms (client timeout 2047 ms). Trace:
W20260807 13:33:44.874390 6638 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.986s user 0.017s sys 0.025s
W20260807 13:33:45.158535 6638 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.271s user 0.017s sys 0.029s
W20260807 13:33:44.458845 8975 consensus_meta.cc:287] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.907s user 0.008s sys 0.006s
W20260807 13:33:45.158228 5666 rpcz_store.cc:269] 0807 13:33:43.248174 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.252399 (+ 4225us) service_pool.cc:227] Handling call
0807 13:33:45.157456 (+1905057us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000ab254. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:45.157615 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2708325120}
W20260807 13:33:44.516861 8910 consensus_meta.cc:287] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.949s user 0.006s sys 0.008s
W20260807 13:33:45.158867 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 3.27082e+06us
W20260807 13:33:44.413067 9046 consensus_meta.cc:287] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.879s user 0.005s sys 0.009s
W20260807 13:33:44.402521 8548 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.336s user 0.012s sys 0.029s
W20260807 13:33:44.951300 8824 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 6.057s user 0.044s sys 0.043s
W20260807 13:33:44.498418 9064 consensus_meta.cc:287] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.043s user 0.000s sys 0.013s
W20260807 13:33:44.464797 8953 consensus_meta.cc:287] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.840s user 0.004s sys 0.009s
I20260807 13:33:44.673527 9066 raft_consensus.cc:3032] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:44.401379 9074 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:33:44.767846 8866 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:44.456998 6639 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.320s user 0.007s sys 0.038s
W20260807 13:33:45.022441 8904 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.015s user 0.008s sys 0.032s
W20260807 13:33:44.745414 8857 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.514s user 0.016s sys 0.034s
I20260807 13:33:45.238747 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:45.238972 5763 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:45.072479 9025 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:44.955476 8430 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:45.011041 8907 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:45.072407 8924 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:45.355553 5662 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.274s user 0.040s sys 0.089s
W20260807 13:33:45.371970 5662 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.291s user 0.042s sys 0.089s
I20260807 13:33:45.353807 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:45.374985 5766 raft_consensus.cc:2379] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:44.538007 8810 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:45.371255 5666 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:45.354719 6638 connection.cc:232] RPC call timeout handler was delayed by -3.936790734063834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260807 13:33:45.370401 5763 raft_consensus.cc:595] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:45.381312 5763 raft_consensus.cc:603] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:45.194024 8355 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:45.197074 8897 raft_consensus.cc:3037] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:45.216439 8824 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 6.323s user 0.045s sys 0.045s
W20260807 13:33:45.377661 6639 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.560s user 0.011s sys 0.055s
W20260807 13:33:45.374277 8873 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 5.772s user 0.064s sys 0.026s
W20260807 13:33:45.422387 8873 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 5.845s user 0.064s sys 0.026s
I20260807 13:33:45.422792 8873 raft_consensus.cc:686] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:45.424005 8873 consensus_queue.cc:237] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:45.217849 9046 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:45.426508 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:45.429679 9046 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:45.388329 9025 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:45.433933 5766 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:45.438946 5770 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:45.216657 9066 raft_consensus.cc:729] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:45.439570 5766 raft_consensus.cc:595] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:45.439999 5766 raft_consensus.cc:603] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 13:33:45.377463 8857 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.146s user 0.021s sys 0.039s
I20260807 13:33:45.370910 9074 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:33:45.441442 5661 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.397s user 0.027s sys 0.023s
W20260807 13:33:45.378490 8588 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 3.068s user 0.004s sys 0.072s
I20260807 13:33:45.205822 9049 consensus_queue.cc:1035] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.220s
I20260807 13:33:45.204867 8975 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:45.217442 8910 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:45.240917 9064 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:45.247170 8953 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:45.377557 8924 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:45.387542 8866 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:46.125612 5656 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 4.189s user 0.019s sys 0.067s
W20260807 13:33:46.331779 5722 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.756s user 0.079s sys 0.147s
W20260807 13:33:45.733376 5663 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.482s user 0.023s sys 0.059s
W20260807 13:33:46.653209 5656 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 4.716s user 0.028s sys 0.077s
W20260807 13:33:46.653591 5663 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.402s user 0.048s sys 0.117s
W20260807 13:33:46.314325 5667 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.865s user 0.057s sys 0.174s
W20260807 13:33:46.654341 5722 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 3.096s user 0.079s sys 0.172s
W20260807 13:33:46.654807 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 3.09814e+06us
W20260807 13:33:46.473901 5764 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.598s user 0.021s sys 0.051s
W20260807 13:33:46.578632 5621 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.505s user 0.000s sys 0.011s
W20260807 13:33:46.655767 5764 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.780s user 0.021s sys 0.054s
W20260807 13:33:46.655939 5621 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.634s user 0.000s sys 0.011s
W20260807 13:33:46.587864 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.516s user 0.000s sys 0.011s
W20260807 13:33:46.657042 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.626s user 0.000s sys 0.012s
W20260807 13:33:46.652503 5661 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.608s user 0.047s sys 0.051s
W20260807 13:33:46.657483 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 1.6267e+06us
W20260807 13:33:45.820521 5767 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.438s user 0.014s sys 0.065s
I20260807 13:33:45.653650 5666 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
W20260807 13:33:46.456642 5659 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.477s user 0.024s sys 0.046s
W20260807 13:33:46.654603 5667 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 3.205s user 0.069s sys 0.190s
W20260807 13:33:46.591636 6637 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.202s user 0.007s sys 0.003s
W20260807 13:33:45.861996 9047 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.840s user 0.018s sys 0.049s
I20260807 13:33:45.411345 8907 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:46.272197 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:46.663568 5767 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.281s user 0.024s sys 0.088s
W20260807 13:33:46.580263 8934 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.569s user 0.000s sys 0.011s
I20260807 13:33:45.410688 8430 consensus_queue.cc:1046] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 1.560s
I20260807 13:33:46.937244 5764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1309) took 3202 ms. Trace:
W20260807 13:33:46.262239 8882 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.503s user 0.010s sys 0.043s
W20260807 13:33:46.463703 8653 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.554s user 0.018s sys 0.061s
I20260807 13:33:46.505316 6681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:46.014039 8957 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 4.830s user 0.052s sys 0.090s
I20260807 13:33:46.797739 9024 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:33:46.430399 8776 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.893s user 0.016s sys 0.056s
W20260807 13:33:46.651731 9105 log.cc:924] Time spent T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.108s user 0.000s sys 0.000s
W20260807 13:33:46.603659 8969 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 6.641s user 0.091s sys 0.170s
W20260807 13:33:45.563059 8926 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 6.249s user 0.030s sys 0.066s
W20260807 13:33:46.653891 8588 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 4.343s user 0.022s sys 0.105s
W20260807 13:33:45.758414 9051 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 3.033s user 0.029s sys 0.061s
W20260807 13:33:46.338253 8994 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.715s user 0.019s sys 0.039s
W20260807 13:33:46.084396 8971 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.442s user 0.017s sys 0.047s
W20260807 13:33:45.607652 9026 consensus_meta.cc:287] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.520s user 0.015s sys 0.003s
W20260807 13:33:46.970935 8934 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.960s user 0.005s sys 0.022s
W20260807 13:33:46.622025 9100 log.cc:924] Time spent T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.110s user 0.000s sys 0.000s
W20260807 13:33:46.620661 9102 log.cc:924] Time spent T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.088s user 0.000s sys 0.000s
I20260807 13:33:45.764276 9000 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:45.572894 9021 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.605s user 0.013s sys 0.065s
W20260807 13:33:46.621385 9111 log.cc:924] Time spent T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260807 13:33:46.755959 9087 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:45.670590 9025 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:45.672045 9016 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:46.952883 9141 log.cc:924] Time spent T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.063s user 0.001s sys 0.000s
W20260807 13:33:45.849255 9052 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.973s user 0.030s sys 0.079s
I20260807 13:33:45.630728 9042 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:46.974149 9047 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.955s user 0.027s sys 0.061s
I20260807 13:33:45.672925 9061 raft_consensus.cc:3032] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:46.658468 9074 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:46.886243 9049 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:45.500648 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 13:33:47.095539 9049 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.099159 6681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57224 (request call id 205) took 1070 ms. Trace:
I20260807 13:33:47.099731 6681 rpcz_store.cc:276] 0807 13:33:46.028401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:46.074813 (+ 46412us) service_pool.cc:227] Handling call
0807 13:33:47.098736 (+1023923us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:46.769903 5662 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.276s user 0.001s sys 0.019s
I20260807 13:33:46.620481 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
W20260807 13:33:47.102624 5662 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.608s user 0.001s sys 0.022s
W20260807 13:33:45.790035 5618 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.610s user 0.061s sys 0.065s
W20260807 13:33:47.105221 5618 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 4.926s user 0.072s sys 0.076s
W20260807 13:33:47.105674 5618 connection.cc:232] RPC call timeout handler was delayed by -1.8679428009781986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260807 13:33:47.012727 9042 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:46.668500 5660 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 3.477s user 0.032s sys 0.042s
W20260807 13:33:47.108143 5660 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 3.917s user 0.033s sys 0.047s
W20260807 13:33:46.351702 5665 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.455s user 0.025s sys 0.051s
W20260807 13:33:47.109856 5665 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.213s user 0.029s sys 0.058s
W20260807 13:33:46.980911 9101 log.cc:924] Time spent T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.063s user 0.000s sys 0.001s
I20260807 13:33:47.111443 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1591) took 3506 ms. Trace:
W20260807 13:33:45.794997 5658 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.727s user 0.032s sys 0.068s
W20260807 13:33:46.808894 5725 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.196:41077 timed out after 1.797s (SENT) [suppressed 7 similar messages]
I20260807 13:33:47.050056 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1577) took 3809 ms. Trace:
W20260807 13:33:47.006395 8971 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.366s user 0.032s sys 0.063s
W20260807 13:33:47.122437 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 313437us
I20260807 13:33:47.122232 5663 rpcz_store.cc:276] 0807 13:33:43.240282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.241236 (+ 954us) service_pool.cc:227] Handling call
0807 13:33:43.250374 (+ 9138us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.250600 (+ 226us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:43.250624 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:43.251045 (+ 421us) log.cc:842] Serialized 26 byte log entry
0807 13:33:46.654130 (+3403085us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:46.654169 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:46.654241 (+ 72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.049230 (+394989us) raft_consensus.cc:1671] finished
0807 13:33:47.049314 (+ 84us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.049725 (+ 411us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":3402586,"threads_started":1,"wal-append.queue_time_us":3683308}
I20260807 13:33:46.998479 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
W20260807 13:33:47.056221 5666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1594) took 3214 ms (client timeout 2054 ms). Trace:
W20260807 13:33:47.125291 5663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1596) took 3209 ms (client timeout 2218 ms). Trace:
W20260807 13:33:46.663924 5769 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.500s user 0.011s sys 0.005s
I20260807 13:33:47.013023 9061 raft_consensus.cc:729] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:47.129311 5769 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.966s user 0.014s sys 0.008s
I20260807 13:33:47.130640 5769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1311) took 3209 ms. Trace:
I20260807 13:33:47.130767 9061 consensus_queue.cc:260] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.130980 5769 rpcz_store.cc:276] 0807 13:33:43.920920 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.925472 (+ 4552us) service_pool.cc:227] Handling call
0807 13:33:43.953044 (+ 27572us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.959748 (+ 6704us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:43.959781 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:43.980940 (+ 21159us) log.cc:842] Serialized 26 byte log entry
0807 13:33:47.130010 (+3149070us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:47.130127 (+ 117us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.130309 (+ 182us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.130379 (+ 70us) raft_consensus.cc:1671] finished
0807 13:33:47.130396 (+ 17us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.130593 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1633,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":58121,"thread_start_us":2966113,"threads_started":1,"wal-append.queue_time_us":2875667}
I20260807 13:33:47.132918 9061 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:33:47.133498 9098 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:47.112015 5665 rpcz_store.cc:276] 0807 13:33:43.604867 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.751892 (+147025us) service_pool.cc:227] Handling call
0807 13:33:43.752217 (+ 325us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.770651 (+ 18434us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:43.770680 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:43.820696 (+ 50016us) log.cc:842] Serialized 26 byte log entry
0807 13:33:47.110665 (+3289969us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:47.110774 (+ 109us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.110933 (+ 159us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.111048 (+ 115us) raft_consensus.cc:1671] finished
0807 13:33:47.111074 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.111358 (+ 284us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17729,"raft.queue_time_us":67699,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":54504,"thread_start_us":3213218,"threads_started":1,"wal-append.queue_time_us":3044615}
W20260807 13:33:46.344900 5761 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.525s user 0.026s sys 0.029s
W20260807 13:33:47.136482 5761 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 3.316s user 0.027s sys 0.038s
W20260807 13:33:47.053623 5503 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.033s user 0.002s sys 0.008s
W20260807 13:33:46.883937 5721 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.852s user 0.012s sys 0.008s
I20260807 13:33:47.050056 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1565) took 4013 ms. Trace:
W20260807 13:33:47.050498 5659 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.070s user 0.031s sys 0.054s
I20260807 13:33:46.971412 5764 rpcz_store.cc:276] 0807 13:33:43.734782 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.734892 (+ 110us) service_pool.cc:227] Handling call
0807 13:33:43.822768 (+ 87876us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.822987 (+ 219us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:43.823009 (+ 22us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:43.872407 (+ 49398us) log.cc:842] Serialized 26 byte log entry
0807 13:33:46.656193 (+2783786us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:46.656227 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:46.656315 (+ 88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:46.936993 (+280678us) raft_consensus.cc:1671] finished
0807 13:33:46.937012 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:46.937160 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":2780395,"threads_started":1,"wal-append.queue_time_us":3059940}
W20260807 13:33:46.769601 6636 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.165s user 0.012s sys 0.007s
W20260807 13:33:46.972065 6637 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.585s user 0.016s sys 0.007s
I20260807 13:33:47.152292 9041 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:46.461184 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:47.154433 6636 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.542s user 0.014s sys 0.009s
I20260807 13:33:47.155616 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1588) took 3551 ms. Trace:
I20260807 13:33:46.967687 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:47.157359 9136 log.cc:924] Time spent T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.190s user 0.001s sys 0.000s
I20260807 13:33:47.157435 6694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57212 (request call id 175) took 1598 ms. Trace:
W20260807 13:33:46.579527 8253 consensus_meta.cc:287] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 1.422s user 0.012s sys 0.000s
I20260807 13:33:47.158363 9103 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:47.159453 8253 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:47.159794 9103 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:45.771929 8464 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 3.783s user 0.063s sys 0.178s
I20260807 13:33:47.166182 9042 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:46.071998 8466 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.640s user 0.067s sys 0.147s
W20260807 13:33:47.166795 8464 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 5.178s user 0.093s sys 0.238s
W20260807 13:33:47.167382 8466 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 3.735s user 0.087s sys 0.189s
I20260807 13:33:45.496405 8664 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:47.169237 8664 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.171315 9024 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:47.171911 9024 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:47.172436 8664 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:45.495548 8810 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:45.572471 8821 raft_consensus.cc:3032] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:47.175419 8821 raft_consensus.cc:729] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:47.176951 8866 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:46.755767 8829 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.250s user 0.005s sys 0.010s
I20260807 13:33:47.177054 8821 consensus_queue.cc:260] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:47.178690 8829 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.747s user 0.010s sys 0.015s
I20260807 13:33:45.582134 8857 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:47.181061 8857 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:45.789124 8868 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.663s user 0.018s sys 0.088s
W20260807 13:33:47.183187 8868 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 4.057s user 0.024s sys 0.107s
I20260807 13:33:46.970317 8907 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:47.186535 8988 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:47.186919 8907 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:47.188642 5542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 1143) took 7899 ms (client timeout 2175 ms). Trace:
W20260807 13:33:47.189065 5542 rpcz_store.cc:269] 0807 13:33:39.288526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:39.443059 (+154533us) service_pool.cc:227] Handling call
0807 13:33:47.188132 (+7745073us) spinlock_profiling.cc:243] Waited 7.61 s on lock 0x7b54003354d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:47.188326 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17499919616}
I20260807 13:33:46.824234 8910 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:46.943694 8953 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:46.972880 8975 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:45.494982 9071 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:46.970427 6639 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.922s user 0.006s sys 0.009s
W20260807 13:33:47.196452 6639 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.164s user 0.006s sys 0.010s
I20260807 13:33:46.046298 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:47.198592 6687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57224 (request call id 204) took 1431 ms (client timeout 1793 ms). Trace:
W20260807 13:33:47.199152 6687 rpcz_store.cc:269] 0807 13:33:45.767426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:46.032562 (+265136us) service_pool.cc:227] Handling call
0807 13:33:47.198345 (+1165783us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:45.703316 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:45.790597 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:47.082909 9150 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:47.082821 9025 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:46.056166 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:47.007892 9026 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:47.093403 5548 raft_consensus.cc:1226] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:47.101641 8881 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.107211 8430 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:47.012461 9052 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 4.136s user 0.036s sys 0.105s
W20260807 13:33:47.010986 9021 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 4.042s user 0.043s sys 0.074s
W20260807 13:33:47.113229 5658 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 4.046s user 0.038s sys 0.086s
I20260807 13:33:47.114187 8440 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:47.056468 5767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1293) took 3774 ms. Trace:
I20260807 13:33:46.996357 9066 consensus_queue.cc:260] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:46.989563 8957 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 5.809s user 0.060s sys 0.109s
W20260807 13:33:46.986691 8653 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 3.079s user 0.022s sys 0.065s
W20260807 13:33:46.983496 8882 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 3.377s user 0.023s sys 0.050s
I20260807 13:33:47.115229 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1568) took 4077 ms. Trace:
W20260807 13:33:46.983798 9120 log.cc:924] Time spent T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.064s user 0.001s sys 0.000s
I20260807 13:33:47.012924 9087 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:47.001354 8969 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 7.133s user 0.104s sys 0.187s
W20260807 13:33:46.992182 9113 log.cc:924] Time spent T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
W20260807 13:33:47.001520 8926 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 7.692s user 0.048s sys 0.140s
W20260807 13:33:47.231566 5501 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.136s user 0.018s sys 0.035s
I20260807 13:33:47.117641 9047 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:47.232718 9047 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.118428 9153 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:47.006089 8924 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:47.120795 8716 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 13:33:47.125758 5663 rpcz_store.cc:269] 0807 13:33:43.915838 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.125071 (+3209233us) service_pool.cc:214] Skipping call since client already timed out
0807 13:33:47.125220 (+ 149us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:33:47.244936 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1592) took 3508 ms. Trace:
W20260807 13:33:47.125397 5666 rpcz_store.cc:269] 0807 13:33:43.842093 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:45.204456 (+1362363us) service_pool.cc:227] Handling call
0807 13:33:47.055887 (+1851431us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.248381 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1593) took 3511 ms. Trace:
I20260807 13:33:47.248867 5666 rpcz_store.cc:276] 0807 13:33:43.736608 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.246734 (+3510126us) service_pool.cc:227] Handling call
0807 13:33:47.247383 (+ 649us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:47.247927 (+ 544us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:47.247972 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:47.248056 (+ 84us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:47.248114 (+ 58us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.248169 (+ 55us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.248311 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.134603 9098 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:47.048692 5621 connection.cc:232] RPC call timeout handler was delayed by -1.5199806939344853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260807 13:33:46.999790 8776 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.463s user 0.016s sys 0.071s
W20260807 13:33:47.005790 8994 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.381s user 0.031s sys 0.047s
W20260807 13:33:47.003794 9051 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 4.278s user 0.037s sys 0.078s
W20260807 13:33:47.141451 5503 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.121s user 0.003s sys 0.009s
W20260807 13:33:47.015079 9125 log.cc:924] Time spent T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.101s user 0.000s sys 0.001s
W20260807 13:33:47.144845 5721 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.111s user 0.012s sys 0.008s
I20260807 13:33:47.148877 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260807 13:33:47.149291 5499 connection.cc:232] RPC call timeout handler was delayed by -1.3560933251865208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260807 13:33:47.152403 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 2.83841e+06us
I20260807 13:33:46.668080 6638 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:47.270991 5499 connection.cc:232] RPC call timeout handler was delayed by -1.1436594401020557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
I20260807 13:33:47.272141 9158 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:47.273056 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 604860us
I20260807 13:33:47.156114 5659 rpcz_store.cc:276] 0807 13:33:43.603903 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.611093 (+ 7190us) service_pool.cc:227] Handling call
0807 13:33:43.763601 (+152508us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.802595 (+ 38994us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:43.802637 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:43.821352 (+ 18715us) log.cc:842] Serialized 26 byte log entry
0807 13:33:46.995170 (+3173818us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:47.154737 (+159567us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:47.154817 (+ 80us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.154989 (+ 172us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.155069 (+ 80us) raft_consensus.cc:1671] finished
0807 13:33:47.155089 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.155520 (+ 431us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":87620,"raft.queue_time_us":57058,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":57074,"spinlock_wait_cycles":5097728,"thread_start_us":3159344,"threads_started":1,"wal-append.queue_time_us":3050311}
W20260807 13:33:47.162915 5722 connection.cc:232] RPC call timeout handler was delayed by -1.9134374978020787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
I20260807 13:33:47.137351 5661 rpcz_store.cc:276] 0807 13:33:43.036446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.036568 (+ 122us) service_pool.cc:227] Handling call
0807 13:33:43.036996 (+ 428us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.037282 (+ 286us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:43.037316 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:43.043637 (+ 6321us) log.cc:842] Serialized 26 byte log entry
0807 13:33:46.657654 (+3614017us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:46.657689 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:46.657766 (+ 77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.049251 (+391485us) raft_consensus.cc:1671] finished
0807 13:33:47.049314 (+ 63us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.049725 (+ 411us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":3613551,"threads_started":1,"wal-append.queue_time_us":3921980}
I20260807 13:33:47.158066 6694 rpcz_store.cc:276] 0807 13:33:45.558530 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:45.558809 (+ 279us) service_pool.cc:227] Handling call
0807 13:33:47.157164 (+1598355us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:47.164412 5665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1597) took 3206 ms (client timeout 2589 ms). Trace:
I20260807 13:33:47.164113 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 1005) took 1733 ms. Trace:
I20260807 13:33:47.144904 9016 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:47.184227 8857 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.282953 9016 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.282972 8857 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:47.287318 8857 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.202214 6685 raft_consensus.cc:2379] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 8: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:47.285795 9016 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:47.274528 5665 rpcz_store.cc:269] 0807 13:33:43.948139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.145498 (+3197359us) service_pool.cc:214] Skipping call since client already timed out
0807 13:33:47.154144 (+ 8646us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260807 13:33:47.194878 8821 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:47.220764 5761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1307) took 3491 ms. Trace:
I20260807 13:33:47.226802 5662 rpcz_store.cc:276] 0807 13:33:43.037438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.037565 (+ 127us) service_pool.cc:227] Handling call
0807 13:33:43.052733 (+ 15168us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.053120 (+ 387us) raft_consensus.cc:1520] Early marking committed up to index 2
0807 13:33:45.374380 (+2321260us) log.cc:842] Serialized 14 byte log entry
0807 13:33:47.103340 (+1728960us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:47.104281 (+ 941us) log.cc:842] Serialized 26 byte log entry
0807 13:33:47.104522 (+ 241us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:47.104575 (+ 53us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.104716 (+ 141us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.114916 (+ 10200us) raft_consensus.cc:1671] finished
0807 13:33:47.114936 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.115173 (+ 237us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6006,"prepare.queue_time_us":3569309,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":3358,"raft.run_cpu_time_us":493,"raft.run_wall_time_us":5349,"thread_start_us":3901729,"threads_started":2,"wal-append.queue_time_us":1600176}
W20260807 13:33:47.231998 5501 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.203s user 0.019s sys 0.035s
I20260807 13:33:47.239358 9047 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:47.240362 9153 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:47.245380 5663 rpcz_store.cc:276] 0807 13:33:43.736288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.243237 (+3506949us) service_pool.cc:227] Handling call
0807 13:33:47.243909 (+ 672us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:47.244443 (+ 534us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:47.244475 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:47.244552 (+ 77us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:47.244628 (+ 76us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.244700 (+ 72us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.244832 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.254910 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 156) took 3484 ms. Trace:
I20260807 13:33:47.222983 5767 rpcz_store.cc:276] 0807 13:33:43.282253 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.282399 (+ 146us) service_pool.cc:227] Handling call
0807 13:33:43.282772 (+ 373us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.283036 (+ 264us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:43.283069 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:43.289462 (+ 6393us) log.cc:842] Serialized 26 byte log entry
0807 13:33:46.967749 (+3678287us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:46.967796 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:46.967870 (+ 74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.055744 (+ 87874us) raft_consensus.cc:1671] finished
0807 13:33:47.055793 (+ 49us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.056160 (+ 367us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":3585306,"threads_started":1,"wal-append.queue_time_us":3684101}
I20260807 13:33:47.263404 8430 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:47.267828 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 13:33:47.267915 8897 consensus_meta.cc:287] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 1.831s user 0.012s sys 0.005s
I20260807 13:33:47.269183 6688 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:47.268678 8440 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:47.318044 8440 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:47.269855 9169 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:47.318295 6680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57212 (request call id 173) took 1865 ms (client timeout 2094 ms). Trace:
W20260807 13:33:47.319012 6680 rpcz_store.cc:269] 0807 13:33:45.440498 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:45.490363 (+ 49865us) service_pool.cc:227] Handling call
0807 13:33:46.037520 (+547157us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b5800005498. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416bce 000000000034aea9 00007ff687242a30 00007ff6873087b4 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:33:47.302130 (+1264610us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":68274048}
W20260807 13:33:47.275916 5722 connection.cc:232] RPC call timeout handler was delayed by -1.8252374979201704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260807 13:33:47.320240 5722 connection.cc:232] RPC call timeout handler was delayed by -1.8090374977327883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260807 13:33:47.320693 5722 connection.cc:232] RPC call timeout handler was delayed by -1.7100374978035688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260807 13:33:47.320989 5722 connection.cc:232] RPC call timeout handler was delayed by -1.6443374978844076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260807 13:33:47.321301 5722 connection.cc:232] RPC call timeout handler was delayed by -1.4778374978341162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260807 13:33:47.321643 5722 connection.cc:232] RPC call timeout handler was delayed by -1.4553374978713691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260807 13:33:47.321986 5722 connection.cc:232] RPC call timeout handler was delayed by -1.4040374979376793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260807 13:33:47.290570 6685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57212 (request call id 174) took 1786 ms (client timeout 1783 ms). Trace:
W20260807 13:33:47.322293 5722 connection.cc:232] RPC call timeout handler was delayed by -1.3581374979112297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260807 13:33:47.322644 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1167) took 8095 ms. Trace:
I20260807 13:33:47.323266 5548 rpcz_store.cc:276] 0807 13:33:39.227408 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:39.720964 (+493556us) service_pool.cc:227] Handling call
0807 13:33:39.721381 (+ 417us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:47.223493 (+7502112us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.322274 (+ 98781us) spinlock_profiling.cc:243] Waited 7.37 s on lock 0x7b54003340d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:47.322567 (+ 293us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16952756608}
I20260807 13:33:47.324069 9026 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:47.324329 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1599) took 2844 ms. Trace:
I20260807 13:33:47.276063 8253 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:47.277616 9150 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.324788 5662 rpcz_store.cc:276] 0807 13:33:44.480150 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.322953 (+2842803us) service_pool.cc:227] Handling call
0807 13:33:47.323432 (+ 479us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:47.323955 (+ 523us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:47.323982 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:47.324050 (+ 68us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:47.324089 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.324149 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.324273 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1457}
I20260807 13:33:47.277753 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 157) took 3458 ms. Trace:
W20260807 13:33:47.282027 9167 log.cc:924] Time spent T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260807 13:33:47.290443 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1570) took 4250 ms. Trace:
I20260807 13:33:47.327037 5663 raft_consensus.cc:1226] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:47.327391 5660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1572) took 4256 ms. Trace:
I20260807 13:33:47.274680 5544 rpcz_store.cc:276] 0807 13:33:45.416665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:45.416821 (+ 156us) service_pool.cc:227] Handling call
0807 13:33:47.150235 (+1733414us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.325927 5661 rpcz_store.cc:276] 0807 13:33:43.819543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.276474 (+3456931us) service_pool.cc:227] Handling call
0807 13:33:47.276984 (+ 510us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:47.277364 (+ 380us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:47.277398 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:47.277460 (+ 62us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:33:47.277515 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.277585 (+ 70us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.277696 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.329120 9151 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:47.290077 8857 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:47.278462 5503 connection.cc:232] RPC call timeout handler was delayed by -1.1665011397562921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260807 13:33:47.300076 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:47.329870 9151 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.330978 5665 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:47.331284 9066 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:47.332603 9151 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.308599 9153 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:47.314764 5659 raft_consensus.cc:1226] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
W20260807 13:33:47.315732 6688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57224 (request call id 203) took 1581 ms (client timeout 1766 ms). Trace:
W20260807 13:33:47.334717 6688 rpcz_store.cc:269] 0807 13:33:45.734772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:45.743827 (+ 9055us) service_pool.cc:227] Handling call
0807 13:33:47.315642 (+1571815us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.291349 8716 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:47.335644 8716 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:47.327913 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1595) took 3453 ms. Trace:
I20260807 13:33:47.336133 5663 rpcz_store.cc:276] 0807 13:33:43.874264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.326242 (+3451978us) service_pool.cc:227] Handling call
0807 13:33:47.326701 (+ 459us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:47.327638 (+ 937us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.327839 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.301107 5666 rpcz_store.cc:276] 0807 13:33:43.770800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.250019 (+3479219us) service_pool.cc:227] Handling call
0807 13:33:47.254143 (+ 4124us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:47.254475 (+ 332us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:47.254499 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:47.254571 (+ 72us) raft_consensus.cc:1631] Marking committed up to 7
0807 13:33:47.254615 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.254699 (+ 84us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.254832 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.328284 8881 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:47.337246 9087 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:47.260241 9025 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.337607 8881 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.297672 5761 rpcz_store.cc:276] 0807 13:33:43.729227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.729410 (+ 183us) service_pool.cc:227] Handling call
0807 13:33:43.729772 (+ 362us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:43.730004 (+ 232us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:47.147557 (+3417553us) log.cc:842] Serialized 14 byte log entry
0807 13:33:47.219492 (+ 71935us) log.cc:842] Serialized 14 byte log entry
0807 13:33:47.220135 (+ 643us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:47.220221 (+ 86us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:47.220325 (+ 104us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.220448 (+ 123us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.220695 (+ 247us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":3092132,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":125,"raft.queue_time_us":217,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":364,"thread_start_us":3386322,"threads_started":2,"wal-append.queue_time_us":70154}
W20260807 13:33:47.276499 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 2.24422e+06us
I20260807 13:33:47.326591 5658 rpcz_store.cc:276] 0807 13:33:43.040242 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.040360 (+ 118us) service_pool.cc:227] Handling call
0807 13:33:43.040715 (+ 355us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.048828 (+ 8113us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:43.048858 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:43.049281 (+ 423us) log.cc:842] Serialized 26 byte log entry
0807 13:33:47.231296 (+4182015us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:47.231387 (+ 91us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.231488 (+ 101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.290173 (+ 58685us) raft_consensus.cc:1671] finished
0807 13:33:47.290193 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.290370 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7707,"raft.queue_time_us":8408,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":5052,"thread_start_us":4156317,"threads_started":1,"wal-append.queue_time_us":3881738}
I20260807 13:33:47.339674 8881 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.341787 8907 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.319159 9169 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.334956 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1598) took 2955 ms. Trace:
W20260807 13:33:47.322772 5722 connection.cc:232] RPC call timeout handler was delayed by -1.3302374978084117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260807 13:33:47.345641 5618 connection.cc:232] RPC call timeout handler was delayed by -3.8446049657650292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260807 13:33:47.484475 5618 connection.cc:232] RPC call timeout handler was delayed by -3.7933049658313394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260807 13:33:47.485819 5618 connection.cc:232] RPC call timeout handler was delayed by -3.6880049658939242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260807 13:33:47.345333 5659 rpcz_store.cc:276] 0807 13:33:44.379899 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.303228 (+2923329us) service_pool.cc:227] Handling call
0807 13:33:47.314431 (+ 11203us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:47.334691 (+ 20260us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.334900 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:47.486430 5618 connection.cc:232] RPC call timeout handler was delayed by -3.5575049659237266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260807 13:33:47.480760 5662 raft_consensus.cc:1226] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:47.426417 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:47.401774 5665 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
W20260807 13:33:47.488009 5618 connection.cc:232] RPC call timeout handler was delayed by -3.5188049657735974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260807 13:33:47.488582 5618 connection.cc:232] RPC call timeout handler was delayed by -3.4936049657408148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260807 13:33:47.488896 5618 connection.cc:232] RPC call timeout handler was delayed by -3.4513049658853561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260807 13:33:47.488898 5722 connection.cc:232] RPC call timeout handler was delayed by -1.2852374978829175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260807 13:33:47.489323 5618 connection.cc:232] RPC call timeout handler was delayed by -3.3433049658779055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260807 13:33:47.489666 5618 connection.cc:232] RPC call timeout handler was delayed by -3.1813049658667296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260807 13:33:47.328338 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1566) took 4291 ms. Trace:
W20260807 13:33:47.489898 5618 connection.cc:232] RPC call timeout handler was delayed by -2.3479049657471478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3165s for a response
W20260807 13:33:47.396766 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 51433.1us
I20260807 13:33:47.493410 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 158) took 2475 ms. Trace:
I20260807 13:33:47.493791 5662 rpcz_store.cc:276] 0807 13:33:45.012167 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.325886 (+2313719us) service_pool.cc:227] Handling call
0807 13:33:47.402894 (+ 77008us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:47.487723 (+ 84829us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.487919 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.416352 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:47.485644 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 212598us
W20260807 13:33:47.322469 6685 rpcz_store.cc:269] 0807 13:33:45.504600 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:45.556646 (+ 52046us) service_pool.cc:227] Handling call
0807 13:33:47.290468 (+1733822us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:47.339691 9025 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.415854 9021 raft_consensus.cc:3032] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
W20260807 13:33:47.501114 5722 connection.cc:232] RPC call timeout handler was delayed by -1.1403374979272485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2363s for a response
I20260807 13:33:47.327884 5660 rpcz_store.cc:276] 0807 13:33:43.071474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.165644 (+ 94170us) service_pool.cc:227] Handling call
0807 13:33:43.182946 (+ 17302us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:43.183187 (+ 241us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:47.108878 (+3925691us) log.cc:842] Serialized 14 byte log entry
0807 13:33:47.326784 (+217906us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:47.326899 (+ 115us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:47.327013 (+ 114us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.327121 (+ 108us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.327336 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":3439486,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":6551,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"thread_start_us":4067652,"threads_started":2,"wal-append.queue_time_us":152354}
I20260807 13:33:47.479303 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:47.313939 8430 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:47.448601 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:47.418871 9049 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:47.419018 9098 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:47.411835 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:47.416893 9041 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:47.412703 9150 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.385469 8464 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:47.411022 8988 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:47.411155 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:47.490278 5667 rpcz_store.cc:276] 0807 13:33:43.036830 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:43.036938 (+ 108us) service_pool.cc:227] Handling call
0807 13:33:43.042715 (+ 5777us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:43.049603 (+ 6888us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:43.449557 (+399954us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b18002a5740. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44b155 00007ff685d4b167 00007ff682380807 00007ff68238ff0f 00007ff68238fe88
0807 13:33:47.051694 (+3602137us) log.cc:842] Serialized 14 byte log entry
0807 13:33:47.150755 (+ 99061us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:47.151475 (+ 720us) log.cc:842] Serialized 26 byte log entry
0807 13:33:47.151609 (+ 134us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:47.151644 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.151782 (+ 138us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.327831 (+176049us) raft_consensus.cc:1671] finished
0807 13:33:47.327977 (+ 146us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.328157 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6449,"prepare.queue_time_us":3563508,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":9992,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":26537,"spinlock_wait_cycles":3851136,"thread_start_us":3688855,"threads_started":2,"wal-append.queue_time_us":102161}
W20260807 13:33:47.518939 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 266704us
W20260807 13:33:47.522823 5722 connection.cc:232] RPC call timeout handler was delayed by -1.0539374977815896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2459s for a response
I20260807 13:33:47.408172 9061 consensus_queue.cc:1046] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260807 13:33:47.590260 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:47.530437 5764 raft_consensus.cc:2379] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:47.517400 9021 raft_consensus.cc:729] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:47.401988 9153 consensus_queue.cc:1046] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.119s
I20260807 13:33:47.520542 8907 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:47.547729 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.541087 9041 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:47.520393 9042 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:47.554616 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:47.545765 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.539288 6636 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:47.553078 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.541992 9051 consensus_queue.cc:1046] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 13:33:47.546990 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.570508 5767 raft_consensus.cc:1261] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:47.568568 8716 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.545383 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:47.548336 9169 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:47.551016 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.546741 9103 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.544243 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:47.549134 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1557) took 6455 ms. Trace:
I20260807 13:33:47.556710 9158 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:47.580920 5665 raft_consensus.cc:1226] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:47.583114 9150 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:47.625507 5769 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:47.625736 9150 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.627311 5770 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:47.628139 9150 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.588773 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:47.628854 5660 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:47.590229 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:47.632428 5662 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:47.622310 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:47.591140 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:47.413645 9064 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.553800 9024 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:47.599308 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 73592.2us
I20260807 13:33:47.487129 9074 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.600216 8988 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:47.601796 5659 raft_consensus.cc:2354] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
W20260807 13:33:47.603288 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 68031.3us
I20260807 13:33:47.602625 9061 raft_consensus.cc:3032] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:47.615007 5771 raft_consensus.cc:2396] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:47.619828 5762 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:47.614542 9042 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:47.621351 5765 raft_consensus.cc:2396] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260807 13:33:47.632361 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.635389 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:47.636991 5658 raft_consensus.cc:2362] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6. Re-sending same reply.
I20260807 13:33:47.637212 5761 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:47.639779 5770 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:47.637018 5763 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:47.637539 9049 raft_consensus.cc:3032] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:47.642554 9049 raft_consensus.cc:729] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:47.642922 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.643015 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.643244 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.643703 9049 consensus_queue.cc:260] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:47.644407 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 105855us
I20260807 13:33:47.602670 8464 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:47.623129 5656 rpcz_store.cc:276] 0807 13:33:41.093436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:41.093552 (+ 116us) service_pool.cc:227] Handling call
0807 13:33:41.150200 (+ 56648us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:41.935684 (+785484us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:46.653742 (+4718058us) log.cc:842] Serialized 14 byte log entry
0807 13:33:47.163070 (+509328us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:47.163778 (+ 708us) log.cc:842] Serialized 26 byte log entry
0807 13:33:47.165179 (+ 1401us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:47.165416 (+ 237us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:47.399332 (+233916us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4800261558. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff68721d7f1 00007ff6872148e7 00007ff68721477a 00007ff68730895f 00007ff687308627 00007ff68731cb2c 00007ff68731cad8 00007ff68731ca58 00007ff68731ca13 00007ff68731bcbc 00007ff68629dbe6
0807 13:33:47.548709 (+149377us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54000e3dd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:47.548759 (+ 50us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:47.548799 (+ 40us) raft_consensus.cc:1671] finished
0807 13:33:47.548810 (+ 11us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:47.548958 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14307,"prepare.queue_time_us":4565330,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":174468,"raft.run_cpu_time_us":4260,"raft.run_wall_time_us":254171,"spinlock_wait_cycles":1831214592,"thread_start_us":5052993,"threads_started":2,"wal-append.queue_time_us":403763}
W20260807 13:33:48.015743 5501 connection.cc:232] RPC call timeout handler was delayed by -6.7634627579245716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2445s for a response
I20260807 13:33:48.020157 5660 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:33:47.648272 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:48.038022 5501 connection.cc:232] RPC call timeout handler was delayed by -6.4112662291154265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260807 13:33:47.664686 5662 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 5. Current term is 6. Ops: []
W20260807 13:33:48.023476 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 366550us
I20260807 13:33:48.038432 5665 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:47.932371 5769 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:47.648001 5767 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:47.666467 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:47.905534 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 66679us
I20260807 13:33:47.643739 5766 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
W20260807 13:33:47.650007 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 153911us
I20260807 13:33:47.644943 5763 raft_consensus.cc:1261] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260807 13:33:48.045535 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:47.654469 8253 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:33:48.050628 5659 raft_consensus.cc:2379] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:47.659936 5667 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
W20260807 13:33:47.977700 9178 log.cc:924] Time spent T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
I20260807 13:33:47.651511 6680 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:47.932914 5389 catalog_manager.cc:5495] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:47.637735 9061 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:48.057192 5770 raft_consensus.cc:2379] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:48.015357 9049 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:48.060664 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 87778.7us
I20260807 13:33:47.652576 9158 raft_consensus.cc:3032] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:33:47.664295 9042 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.041254 8716 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:47.971843 6688 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:48.088255 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.088934 5659 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:48.095793 5662 raft_consensus.cc:1261] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:33:48.102682 8988 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:48.107620 5501 connection.cc:232] RPC call timeout handler was delayed by -6.3394497230183333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260807 13:33:48.108130 5501 connection.cc:232] RPC call timeout handler was delayed by -6.2348662291187793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260807 13:33:48.105244 8988 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.078486 8253 raft_consensus.cc:686] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:48.076144 9158 raft_consensus.cc:729] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:48.081035 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:48.090960 5389 catalog_manager.cc:5495] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:48.091256 9024 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.090005 9074 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.124720 8253 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:48.125290 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:47.663790 9021 consensus_queue.cc:260] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.166213 5662 raft_consensus.cc:1226] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:48.157600 5389 catalog_manager.cc:5495] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:48.161090 9021 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:48.179230 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.206005 5659 raft_consensus.cc:2379] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:48.183394 9061 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.200009 5389 catalog_manager.cc:5495] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 2 to 3, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:48.215696 5620 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:48.223860 5665 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:48.187942 9158 consensus_queue.cc:260] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:48.237754 5389 catalog_manager.cc:5495] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 6, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 6 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
W20260807 13:33:48.250573 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 131804us
W20260807 13:33:48.251629 5394 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51216 (request call id 194) took 13983 ms (client timeout 15000 ms). Trace:
I20260807 13:33:48.278877 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.279716 5665 raft_consensus.cc:2396] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260807 13:33:48.281034 5665 raft_consensus.cc:1226] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:48.281131 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.281780 5659 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:48.282702 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.283921 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:48.284878 5656 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:48.285941 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:48.292980 5767 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:48.301167 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.301563 5660 raft_consensus.cc:1226] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:48.259500 9061 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:48.302874 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.303182 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.244071 8464 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.302453 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.261179 8716 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:48.302402 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.332252 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:48.333354 5665 raft_consensus.cc:2379] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:48.343530 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.347041 5656 raft_consensus.cc:2379] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:48.329181 5389 catalog_manager.cc:5495] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 5, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 5 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:48.356222 5662 raft_consensus.cc:2379] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:48.357052 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:48.352252 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 47313.4us
I20260807 13:33:48.262466 8873 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:48.359546 5658 raft_consensus.cc:2396] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260807 13:33:48.358045 8716 raft_consensus.cc:686] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:48.391083 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.392073 5662 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:48.424458 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 544322us
I20260807 13:33:48.425114 5659 raft_consensus.cc:1226] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 13:33:48.435984 9158 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:48.440267 5659 raft_consensus.cc:1226] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260807 13:33:48.259760 5394 rpcz_store.cc:269] 0807 13:33:34.259422 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:34.271805 (+ 12383us) service_pool.cc:227] Handling call
0807 13:33:48.242840 (+13971035us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:37.754055 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:37.761204 (+ 7149us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:37.761235 (+ 31us) write_op.cc:435] Acquired schema lock
0807 13:33:37.761251 (+ 16us) tablet.cc:660] Decoding operations
0807 13:33:37.762385 (+ 1134us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:37.762446 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:37.762471 (+ 25us) tablet.cc:683] Acquiring locks for 13 operations
0807 13:33:37.763473 (+ 1002us) tablet.cc:699] Row locks acquired
0807 13:33:37.763487 (+ 14us) write_op.cc:260] PREPARE: finished
0807 13:33:37.763623 (+ 136us) write_op.cc:270] Start()
0807 13:33:37.763738 (+ 115us) write_op.cc:276] Timestamp: P: 1786109617763578 usec, L: 0
0807 13:33:37.763761 (+ 23us) op_driver.cc:331] REPLICATION: starting
0807 13:33:37.878221 (+114460us) log.cc:842] Serialized 5197 byte log entry
0807 13:33:38.086141 (+207920us) op_driver.cc:444] REPLICATION: finished
0807 13:33:40.621672 (+2535531us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff67f4305fe 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff685d86410
0807 13:33:41.894585 (+1272913us) write_op.cc:301] APPLY: starting
0807 13:33:41.899179 (+ 4594us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:41.990602 (+ 91423us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:41.995708 (+ 5106us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:42.875458 (+879750us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:42.875843 (+ 385us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0807 13:33:42.875909 (+ 66us) write_op.cc:312] APPLY: finished
0807 13:33:42.876366 (+ 457us) log.cc:842] Serialized 94 byte log entry
0807 13:33:47.232557 (+4356191us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:47.233146 (+ 589us) write_op.cc:454] Released schema lock
0807 13:33:47.233274 (+ 128us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:47.233814 (+ 540us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:47.233852 (+ 38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6890,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":3751127,"apply.run_cpu_time_us":151139,"apply.run_wall_time_us":5415334,"num_ops":13,"prepare.queue_time_us":201005,"prepare.run_cpu_time_us":4745,"prepare.run_wall_time_us":157446,"replication_time_us":298819,"spinlock_wait_cycles":4463360,"thread_start_us":8240142,"threads_started":3,"wal-append.queue_time_us":4075454,"wal-append.run_cpu_time_us":1611,"wal-append.run_wall_time_us":1065282}]]}
I20260807 13:33:48.450381 5389 catalog_manager.cc:5495] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:48.445019 6688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:48.455669 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:48.455768 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 351928us
I20260807 13:33:48.463414 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.459875 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.465001 5662 raft_consensus.cc:2379] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:48.486555 5501 connection.cc:232] RPC call timeout handler was delayed by -5.9336523178499192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260807 13:33:48.486984 5501 connection.cc:232] RPC call timeout handler was delayed by -5.83493099687621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260807 13:33:48.487320 5501 connection.cc:232] RPC call timeout handler was delayed by -5.7506662290543318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25880000000000003s for a response
I20260807 13:33:48.472297 5389 catalog_manager.cc:5495] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 6 to 7, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:48.464969 6687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:48.466758 6688 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:48.501757 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.493486 5389 catalog_manager.cc:5495] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:48.491374 9064 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:48.454312 8988 consensus_queue.cc:1035] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.041s
I20260807 13:33:48.448508 8873 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.535199 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.536429 5662 raft_consensus.cc:2396] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260807 13:33:48.536535 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:48.546530 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:48.527643 9064 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:48.584718 8988 consensus_queue.cc:1225] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260807 13:33:48.621207 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 203233us
I20260807 13:33:48.598405 9064 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:48.518489 8716 consensus_queue.cc:237] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.660081 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:48.661221 6691 raft_consensus.cc:2396] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260807 13:33:48.661264 9197 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:48.631911 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:48.661988 9197 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.663287 8821 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:48.663861 8821 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.664359 9197 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.665848 8821 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.602440 9183 consensus_queue.cc:1046] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.208s
I20260807 13:33:48.660248 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:48.681553 5389 catalog_manager.cc:5495] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 5, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 5 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:48.697469 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:48.672075 8873 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.700794 5620 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:48.707000 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:48.713660 9150 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:48.714082 9150 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:48.714586 9150 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:48.719074 5620 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:48.774013 9024 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:48.774542 9024 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:48.774874 9066 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:48.774933 9024 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:48.775555 9066 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:48.776887 9041 consensus_meta.cc:287] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.143s user 0.010s sys 0.000s
I20260807 13:33:48.777275 9041 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.777688 9066 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:48.778684 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 59706.7us
I20260807 13:33:48.779521 5620 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:48.780349 8988 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:48.780865 8988 raft_consensus.cc:686] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:48.781807 8988 consensus_queue.cc:237] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.782305 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:48.785461 5620 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:48.786906 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 61102us
I20260807 13:33:48.789510 9207 consensus_queue.cc:1046] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260807 13:33:48.790485 9203 raft_consensus.cc:3032] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:48.790928 9203 raft_consensus.cc:729] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:48.792018 9203 consensus_queue.cc:260] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.793664 9203 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:48.719717 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 268613us
I20260807 13:33:48.797397 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:48.798475 6691 raft_consensus.cc:2396] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260807 13:33:48.798761 5659 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 13:33:48.801244 9183 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:33:48.808282 9061 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:48.808852 9061 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.810915 9061 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:48.811650 9066 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
W20260807 13:33:48.818079 5501 connection.cc:232] RPC call timeout handler was delayed by -5.3822309970855713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260807 13:33:48.818616 5501 connection.cc:232] RPC call timeout handler was delayed by -5.2958309969399124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260807 13:33:48.818987 5501 connection.cc:232] RPC call timeout handler was delayed by -5.1957728092093021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260807 13:33:48.819329 5501 connection.cc:232] RPC call timeout handler was delayed by -4.870872809085995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260807 13:33:48.819667 5501 connection.cc:232] RPC call timeout handler was delayed by -4.0626728092320263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3025s for a response
I20260807 13:33:48.823385 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.830647 5620 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:48.815280 9049 consensus_meta.cc:287] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.731s user 0.010s sys 0.003s
W20260807 13:33:48.833618 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 335519us
I20260807 13:33:48.697407 6693 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:48.724840 5389 catalog_manager.cc:5495] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:48.837201 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.845178 9066 raft_consensus.cc:686] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:48.845831 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.846295 8988 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:33:48.837826 9021 consensus_meta.cc:287] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.655s user 0.012s sys 0.001s
I20260807 13:33:48.857069 5660 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:48.822119 9074 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:48.850157 5389 catalog_manager.cc:5495] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 6 to 7, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 7 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:48.856411 5764 raft_consensus.cc:2396] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260807 13:33:48.863785 5663 raft_consensus.cc:2396] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:48.870280 5389 catalog_manager.cc:5495] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:48.864467 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:48.950237 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:48.917227 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:48.873080 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 44271.1us
I20260807 13:33:48.951184 5658 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:48.936811 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.936786 5767 raft_consensus.cc:1261] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260807 13:33:48.916800 5389 catalog_manager.cc:5495] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:48.914824 5542 raft_consensus.cc:1226] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:48.849997 8988 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:48.964682 5767 pending_rounds.cc:76] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 2
I20260807 13:33:48.941430 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.874218 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.967833 5663 raft_consensus.cc:2379] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 8: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:48.940647 9150 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.970721 5548 raft_consensus.cc:1226] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:48.948098 9207 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:48.972875 9207 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.936285 9066 consensus_queue.cc:237] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.974347 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:48.972401 9150 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.915079 9061 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:48.975337 9061 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.973476 9064 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.977218 5620 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:48.938715 6680 consensus_meta.cc:287] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 0.840s user 0.006s sys 0.006s
I20260807 13:33:48.968909 5767 pending_rounds.cc:97] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260807 13:33:48.982025 5667 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:48.982720 5771 raft_consensus.cc:2379] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:48.909202 9153 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:48.978523 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:48.986781 9200 consensus_queue.cc:1046] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.083s
I20260807 13:33:48.987820 9214 raft_consensus.cc:3032] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:48.988238 9214 raft_consensus.cc:729] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:48.989466 5763 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:48.989228 9214 consensus_queue.cc:260] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.991595 9041 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:48.991773 9214 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:48.985459 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:48.979056 9221 consensus_queue.cc:1035] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260807 13:33:48.990669 5621 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:48.997182 9212 consensus_queue.cc:1046] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 13:33:48.998163 9212 consensus_queue.cc:1225] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer d6b8ccce5b91423b8673ddfbbf2c1b1c log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260807 13:33:48.998876 9153 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:48.999717 9212 raft_consensus.cc:3032] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:33:48.983850 5767 raft_consensus.cc:2866] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:48.977586 8988 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:48.875334 9074 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:49.001941 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.006634 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.006088 5389 catalog_manager.cc:5495] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 5 to 6, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 6 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:49.008400 5658 raft_consensus.cc:1226] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:49.008986 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:48.850955 9024 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:49.009184 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:49.010851 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:49.011734 5761 raft_consensus.cc:1226] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260807 13:33:49.012257 9103 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:33:49.077137 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.013270 5621 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:49.014622 5764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32950 (request call id 1327) took 1461 ms (client timeout 1576 ms). Trace:
W20260807 13:33:49.107944 5764 rpcz_store.cc:269] 0807 13:33:47.553086 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.606249 (+ 53163us) service_pool.cc:227] Handling call
0807 13:33:49.014326 (+1408077us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540029efd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:49.014516 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2767243648}
I20260807 13:33:49.015461 5766 raft_consensus.cc:1226] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:49.015569 8253 raft_consensus.cc:3032] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:49.017937 9207 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:49.115705 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.116914 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.019222 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:49.020761 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.119231 5763 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 3.
I20260807 13:33:49.027388 5770 raft_consensus.cc:2396] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260807 13:33:49.007287 9200 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:49.051087 9074 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:49.052320 9064 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:49.022611 9209 consensus_queue.cc:1046] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260807 13:33:49.053198 5660 raft_consensus.cc:2379] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:49.009443 9212 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:33:49.053625 9211 log.cc:924] Time spent T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.088s user 0.001s sys 0.000s
I20260807 13:33:49.002368 6680 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:49.141047 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.141744 5548 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
W20260807 13:33:49.142007 6680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37838 (request call id 136) took 1800 ms (client timeout 1970 ms). Trace:
I20260807 13:33:49.141423 9212 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:49.142550 6680 rpcz_store.cc:269] 0807 13:33:47.341320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:47.395591 (+ 54271us) service_pool.cc:227] Handling call
0807 13:33:49.141828 (+1746237us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400542754. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:49.141950 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":252385152}
I20260807 13:33:49.054849 5665 raft_consensus.cc:1226] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:49.055637 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:49.143556 9212 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:49.054921 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:49.143999 5658 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:49.050031 5656 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:49.056849 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.145328 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:49.145771 5762 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:49.145889 5548 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 7
I20260807 13:33:49.146669 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.147238 5762 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:49.057535 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.148109 5771 raft_consensus.cc:2396] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:49.032008 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:49.041800 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.045266 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.058766 9024 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:49.019189 9041 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
W20260807 13:33:49.108569 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 95382.9us
I20260807 13:33:49.149286 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:49.149825 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:49.152266 5543 raft_consensus.cc:1261] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260807 13:33:49.110563 5769 raft_consensus.cc:2396] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260807 13:33:49.114760 9223 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:49.114995 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.112983 8253 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:49.113080 5389 catalog_manager.cc:5495] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 5, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 5 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:49.120464 5766 raft_consensus.cc:1226] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:49.156255 5656 raft_consensus.cc:2362] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4. Re-sending same reply.
I20260807 13:33:49.168408 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.172554 5656 raft_consensus.cc:1226] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:49.174099 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:49.132468 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.176841 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.177174 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.177489 5765 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:49.170607 9041 raft_consensus.cc:686] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:49.178385 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:49.180239 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.180315 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.180936 5769 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:49.121168 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.134981 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.185626 5770 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:49.134928 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.135663 8821 consensus_queue.cc:1046] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:49.133802 9200 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:49.136755 5763 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:49.139905 9061 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:49.142160 6694 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:49.055799 9153 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:49.110388 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 87415us
I20260807 13:33:49.152640 5543 pending_rounds.cc:76] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 2
I20260807 13:33:49.160564 5660 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:49.196326 5543 pending_rounds.cc:97] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260807 13:33:49.179049 9041 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:49.199626 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 64447.5us
I20260807 13:33:49.188669 5389 catalog_manager.cc:5495] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 5, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 5 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:49.190488 5766 raft_consensus.cc:2379] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:49.128219 8988 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:49.190735 5656 raft_consensus.cc:1226] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:49.204329 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:49.204547 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:49.201740 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.191030 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:49.192749 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 88060.5us
I20260807 13:33:49.193804 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.194923 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.196342 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.197336 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.207567 5771 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:49.188364 5767 raft_consensus.cc:2379] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:49.201046 5552 raft_consensus.cc:2396] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260807 13:33:49.196615 5543 raft_consensus.cc:2866] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:49.208546 5389 catalog_manager.cc:5495] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:49.206321 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.201366 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:49.207979 5499 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:49.213311 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.216022 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.221071 5761 raft_consensus.cc:2379] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:49.222363 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.222771 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.224722 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.225368 5763 raft_consensus.cc:2396] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260807 13:33:49.226457 5389 catalog_manager.cc:5495] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 5, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 5 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:49.227650 5389 catalog_manager.cc:5495] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 6 to 7, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 7 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:49.228667 5389 catalog_manager.cc:5495] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:49.230038 5661 raft_consensus.cc:1226] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:49.232059 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.232645 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.237600 5766 raft_consensus.cc:2379] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:49.237412 5499 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:49.234534 5555 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:49.237896 5662 raft_consensus.cc:1226] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:49.235795 5761 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:49.235893 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.236711 5548 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:49.256423 5769 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:49.257019 5766 raft_consensus.cc:1226] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:49.258019 5770 raft_consensus.cc:1226] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260807 13:33:49.258414 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.262991 5766 raft_consensus.cc:1261] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 13:33:49.265540 5767 raft_consensus.cc:1261] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260807 13:33:49.268195 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.265846 5767 pending_rounds.cc:76] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 3
I20260807 13:33:49.278268 5767 pending_rounds.cc:97] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260807 13:33:49.278561 5767 raft_consensus.cc:2866] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:49.235087 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:49.280367 5499 leader_election.cc:398] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:33:49.286377 5499 leader_election.cc:401] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:49.210898 8253 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:49.283531 5763 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260807 13:33:49.285686 5554 raft_consensus.cc:2396] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260807 13:33:49.286545 5389 catalog_manager.cc:5495] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 5, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 5 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:49.291647 5770 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:49.293124 5763 pending_rounds.cc:76] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 3
I20260807 13:33:49.293428 5763 pending_rounds.cc:97] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260807 13:33:49.293704 5763 raft_consensus.cc:2866] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:49.297199 6680 raft_consensus.cc:2362] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 5. Re-sending same reply.
I20260807 13:33:49.297909 8988 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:49.298359 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.299163 5763 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:49.266597 8821 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:49.302281 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:49.314484 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 57538.5us
I20260807 13:33:49.313824 5765 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:49.321056 5766 raft_consensus.cc:1226] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:49.321303 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.323036 5767 raft_consensus.cc:1261] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:49.325197 5548 raft_consensus.cc:2379] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
W20260807 13:33:49.326814 5722 leader_election.cc:334] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.670s (SENT)
I20260807 13:33:49.326578 5725 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:49.326872 9215 log.cc:924] Time spent T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.194s user 0.000s sys 0.001s
I20260807 13:33:49.343444 5662 raft_consensus.cc:1226] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
W20260807 13:33:49.328245 9216 log.cc:924] Time spent T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.194s user 0.000s sys 0.001s
I20260807 13:33:49.320540 9214 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:33:49.327486 8253 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:49.329907 8821 raft_consensus.cc:686] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:49.358515 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.358888 5666 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:49.360625 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.363338 5765 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:49.353497 9153 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:49.364851 5499 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:33:49.368423 9227 log.cc:924] Time spent T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.073s user 0.000s sys 0.000s
I20260807 13:33:49.369007 5769 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:49.374456 8821 consensus_queue.cc:237] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:49.373741 5762 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:49.375857 9200 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:49.388288 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.358408 8653 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:49.398046 8653 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:49.398573 8653 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:49.403242 9153 raft_consensus.cc:686] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:49.404390 9153 consensus_queue.cc:237] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:49.406927 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.407640 5765 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:49.396680 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.409989 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.410755 5762 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 5
I20260807 13:33:49.418669 9196 raft_consensus.cc:3032] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:49.419150 9196 raft_consensus.cc:729] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:49.428148 5771 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
W20260807 13:33:49.436028 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 73364.9us
I20260807 13:33:49.442791 5542 raft_consensus.cc:2379] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 8: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:49.443466 5545 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 13:33:49.440318 5499 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:49.447919 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:49.451009 5722 leader_election.cc:334] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.797s (SENT)
I20260807 13:33:49.451128 5769 pending_rounds.cc:76] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 1
I20260807 13:33:49.454898 5769 pending_rounds.cc:97] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 13:33:49.455235 5769 raft_consensus.cc:2866] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:49.456547 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:49.459765 9212 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:49.461141 5764 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:49.463382 5762 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:49.464918 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.465647 5552 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:49.466508 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.467200 5762 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:49.467933 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:49.462193 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.466651 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.456156 9199 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:49.466542 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.483295 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.454613 9200 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:49.484130 5553 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:49.419986 9214 consensus_queue.cc:1046] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260807 13:33:49.486490 5765 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:49.492340 9061 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:49.498725 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.499622 8873 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:33:49.501161 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:49.518075 5722 leader_election.cc:334] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.861s (SENT)
I20260807 13:33:49.519727 5761 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
W20260807 13:33:49.661026 5618 leader_election.cc:334] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.502s (SENT)
I20260807 13:33:49.954449 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:49.954730 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.962198 5764 raft_consensus.cc:1261] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260807 13:33:49.591457 9251 log.cc:924] Time spent T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.134s user 0.000s sys 0.000s
I20260807 13:33:49.608068 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.578998 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.967710 5765 raft_consensus.cc:2379] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:49.599589 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.604179 5548 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:49.915982 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:33:49.601949 5620 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:49.602391 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:49.603889 5767 raft_consensus.cc:1261] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:49.953428 5771 raft_consensus.cc:3032] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:49.971447 5771 raft_consensus.cc:729] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:49.644254 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.608917 9197 raft_consensus.cc:3032] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:49.520542 5542 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
W20260807 13:33:49.691249 9263 log.cc:924] Time spent T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.126s user 0.000s sys 0.000s
I20260807 13:33:49.579236 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.961593 5618 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:49.483024 9199 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:49.677066 6637 leader_election.cc:334] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.199s (SENT)
I20260807 13:33:49.975571 9197 raft_consensus.cc:729] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:49.973937 6694 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:49.975023 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.995078 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.996568 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.997558 5548 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:49.638554 8653 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:49.577816 5499 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:49.881958 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:49.976866 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.635995 9209 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:49.493384 9200 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:49.980157 5545 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:49.978236 5552 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:33:50.002552 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.999015 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.980979 5771 consensus_queue.cc:260] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.003789 5542 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:50.004225 9200 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:50.004673 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.005298 5542 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:49.992686 9199 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:50.003839 5771 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:50.006071 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.007364 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.007557 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:49.955667 9061 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:50.006278 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 502459us
I20260807 13:33:50.008241 5548 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:50.010315 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.013136 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.011638 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.013669 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:50.018388 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:49.502597 9196 consensus_queue.cc:260] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.020462 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:50.039552 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 362499us
I20260807 13:33:50.042948 5770 raft_consensus.cc:2396] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260807 13:33:50.051254 5548 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:50.060413 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.010970 9214 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader election won for term 4
I20260807 13:33:49.993846 9197 consensus_queue.cc:260] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:50.061300 5548 raft_consensus.cc:2379] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:50.014659 9066 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:50.065838 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.064764 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.067816 5545 raft_consensus.cc:2396] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260807 13:33:50.066601 5542 raft_consensus.cc:2362] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7. Re-sending same reply.
I20260807 13:33:50.074348 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.074602 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.042405 9042 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:50.073623 9066 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:50.077205 9066 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:50.008579 9209 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:50.081614 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.050873 8821 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:33:50.075412 5553 raft_consensus.cc:2362] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6. Re-sending same reply.
I20260807 13:33:50.097880 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.098659 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.099921 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:50.101692 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 499807us
I20260807 13:33:50.104606 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.105623 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.105666 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.106549 5548 raft_consensus.cc:2379] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:50.110178 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.059433 8464 consensus_queue.cc:1046] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260807 13:33:50.060249 9212 consensus_queue.cc:1046] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260807 13:33:50.096798 9214 raft_consensus.cc:686] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:50.098670 9196 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:50.120021 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:50.125077 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 70602.3us
I20260807 13:33:50.125377 5545 raft_consensus.cc:2396] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260807 13:33:50.113220 9203 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:50.077220 8873 consensus_queue.cc:1046] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260807 13:33:50.126672 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 81963.8us
W20260807 13:33:50.127010 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 58797.9us
I20260807 13:33:50.146238 5548 raft_consensus.cc:2396] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:50.098071 9042 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:50.150759 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.152012 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.113862 8821 consensus_queue.cc:1046] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260807 13:33:50.123781 9281 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:50.158408 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.163290 5545 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
W20260807 13:33:50.160851 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 57124us
I20260807 13:33:50.161973 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.128912 6680 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 13:33:50.165388 5620 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:50.167948 9287 consensus_queue.cc:1046] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 13:33:50.169684 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 547587us
I20260807 13:33:50.170271 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:50.170475 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.170919 5660 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:50.171258 5548 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:50.172124 6636 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:50.173106 9277 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:50.173519 9277 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:50.154186 8873 raft_consensus.cc:3032] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:50.174311 8873 raft_consensus.cc:729] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:50.174506 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.174410 9288 consensus_queue.cc:1035] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:50.175220 5548 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 2.
I20260807 13:33:50.175917 9288 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:50.176060 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.176404 9288 raft_consensus.cc:686] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:50.176627 5548 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:33:50.144801 5771 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:50.177392 9288 consensus_queue.cc:237] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.178623 5771 raft_consensus.cc:595] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:50.179003 5771 raft_consensus.cc:603] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:50.173923 9277 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:50.183727 5548 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:33:50.196517 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:50.194628 5618 leader_election.cc:334] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.560s (SENT)
W20260807 13:33:50.198282 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 48674us
I20260807 13:33:50.198371 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:50.181177 9275 log.cc:924] Time spent T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
W20260807 13:33:50.198418 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 68336us
I20260807 13:33:50.202719 5721 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:50.129568 9203 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.207499 5620 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:50.208942 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:50.201282 9287 raft_consensus.cc:3032] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:50.212078 9287 raft_consensus.cc:729] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:50.213801 9287 consensus_queue.cc:260] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.215447 9287 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:50.216915 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.217736 5545 raft_consensus.cc:2379] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:50.218734 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.220098 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.223629 5545 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:50.224424 5545 raft_consensus.cc:1226] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:50.197453 9042 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:50.222865 5771 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:50.230125 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.230926 5548 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:50.175244 8873 consensus_queue.cc:260] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.152837 9272 consensus_queue.cc:1046] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.058s
I20260807 13:33:50.206277 9207 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:50.208030 9061 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:50.225600 9267 log.cc:924] Time spent T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.124s user 0.000s sys 0.001s
I20260807 13:33:50.241477 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.242564 5552 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
W20260807 13:33:50.246726 9276 log.cc:924] Time spent T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.091s user 0.001s sys 0.000s
I20260807 13:33:50.246781 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.255707 9289 consensus_queue.cc:1046] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260807 13:33:50.256062 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 1156) took 1017 ms. Trace:
I20260807 13:33:50.256386 5555 rpcz_store.cc:276] 0807 13:33:49.238406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:49.238550 (+ 144us) service_pool.cc:227] Handling call
0807 13:33:50.255837 (+1017287us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400334fd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:50.255978 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1621540224}
I20260807 13:33:50.233532 9292 raft_consensus.cc:3032] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:50.259100 5555 raft_consensus.cc:1261] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:50.259774 5552 raft_consensus.cc:1261] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260807 13:33:50.262368 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 58293.9us
I20260807 13:33:50.265538 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:50.266201 5660 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
W20260807 13:33:50.267113 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 65104.4us
I20260807 13:33:50.267416 6636 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:50.243769 8873 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:50.221511 9281 consensus_queue.cc:1035] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260807 13:33:50.270256 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:50.276232 9066 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.276844 6680 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:50.269665 9061 consensus_queue.cc:1046] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260807 13:33:50.273850 9042 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260807 13:33:50.270020 9270 log.cc:924] Time spent T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.199s user 0.000s sys 0.001s
I20260807 13:33:50.278519 9042 raft_consensus.cc:482] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:50.274295 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.239070 8653 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:50.228060 9214 consensus_queue.cc:237] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.258816 9199 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.278721 9061 raft_consensus.cc:3032] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:50.505098 9061 raft_consensus.cc:729] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:50.479924 9209 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:50.505291 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.282383 5769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1345) took 1138 ms. Trace:
I20260807 13:33:50.331799 5542 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:50.506062 9061 consensus_queue.cc:260] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.507484 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.497527 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:50.238657 9296 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:50.508876 5766 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 7.
I20260807 13:33:50.262907 9292 raft_consensus.cc:729] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:50.506624 5769 rpcz_store.cc:276] 0807 13:33:49.144153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:49.409009 (+264856us) service_pool.cc:227] Handling call
0807 13:33:49.443894 (+ 34885us) raft_consensus.cc:1457] Updating replica for 3 ops
0807 13:33:49.471229 (+ 27335us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:49.471263 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0807 13:33:49.484500 (+ 13237us) log.cc:842] Serialized 78 byte log entry
0807 13:33:49.957016 (+472516us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:50.078315 (+121299us) log.cc:842] Serialized 14 byte log entry
0807 13:33:50.101429 (+ 23114us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:50.101529 (+ 100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:50.282167 (+180638us) raft_consensus.cc:1671] finished
0807 13:33:50.282192 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:50.282326 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":88878,"prepare.queue_time_us":168471,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":37168,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":16641,"thread_start_us":339224,"threads_started":2,"wal-append.queue_time_us":516504}
I20260807 13:33:50.509363 5552 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:50.510596 9292 consensus_queue.cc:260] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.463639 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.511950 5553 raft_consensus.cc:2379] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 8: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:50.512632 9292 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:50.512794 9199 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:50.512573 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:50.480476 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 245356us
W20260807 13:33:50.515017 5618 leader_election.cc:334] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.559s (SENT)
I20260807 13:33:50.514616 5555 raft_consensus.cc:1261] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:50.515416 5618 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:50.516191 9281 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:50.517584 5660 raft_consensus.cc:1203] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-5.4] Dedup: 5.4->[]
I20260807 13:33:50.518154 5660 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 7. Ops: [5.4-5.4]
W20260807 13:33:50.449901 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 182524us
I20260807 13:33:50.508312 5542 raft_consensus.cc:2362] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6. Re-sending same reply.
I20260807 13:33:50.520110 5552 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:50.520787 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.518563 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.522296 5552 raft_consensus.cc:1261] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:50.522819 5545 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:33:50.523674 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:50.524089 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:50.524490 5658 raft_consensus.cc:2379] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:50.284590 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:50.527578 5618 leader_election.cc:334] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.516s (SENT)
I20260807 13:33:50.528736 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 1049) took 1304 ms. Trace:
I20260807 13:33:50.505123 9197 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:50.518059 9270 log.cc:924] Time spent T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.238s user 0.006s sys 0.004s
I20260807 13:33:50.529856 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:50.509289 9042 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:50.526051 9066 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:50.490362 9200 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.535429 5661 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:50.535218 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:50.530009 5543 rpcz_store.cc:276] 0807 13:33:49.224191 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:49.224339 (+ 148us) service_pool.cc:227] Handling call
0807 13:33:50.528053 (+1303714us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54003976d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:50.528658 (+ 605us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1779750784}
I20260807 13:33:50.550959 5544 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:50.283289 9203 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:50.504047 9223 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260807 13:33:50.552430 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.432753 6680 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:50.529943 9061 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:50.570418 9200 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:50.574043 9297 log.cc:924] Time spent T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Append to log took a long time: real 0.166s user 0.002s sys 0.002s
I20260807 13:33:50.574769 9293 raft_consensus.cc:3032] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:50.575230 9293 raft_consensus.cc:729] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:50.576110 9293 consensus_queue.cc:260] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.563323 5548 raft_consensus.cc:2396] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260807 13:33:50.577535 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 49981.7us
W20260807 13:33:50.566900 5372 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet fc6f41d0f11d4c6295bae40c23631a4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 14f62bf285c448b9b7a21fabd7a5f0bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:50.522063 9296 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:50.578352 5618 leader_election.cc:334] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.676s (SENT)
I20260807 13:33:50.576256 9042 raft_consensus.cc:504] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:50.588104 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.587164 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.584276 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:50.592397 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 69227.7us
I20260807 13:33:50.597419 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:50.597892 5618 leader_election.cc:334] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.821s (SENT)
I20260807 13:33:50.598022 5555 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:50.598510 9042 leader_election.cc:288] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:50.598817 5618 leader_election.cc:334] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.864s (SENT)
I20260807 13:33:50.599212 5618 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:50.599723 5552 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:50.601637 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:50.602451 5771 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 9
I20260807 13:33:50.603950 9223 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:50.605048 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:50.605230 5618 leader_election.cc:334] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.892s (SENT)
I20260807 13:33:50.605765 5618 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:50.606460 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.606688 9223 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:33:50.607115 5542 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:50.607476 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.608009 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.608719 5542 raft_consensus.cc:2362] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7. Re-sending same reply.
I20260807 13:33:50.608655 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.608062 5552 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:50.609695 5545 raft_consensus.cc:2362] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6. Re-sending same reply.
W20260807 13:33:50.608024 5618 leader_election.cc:334] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.939s (SENT)
I20260807 13:33:50.617341 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:50.617746 5618 leader_election.cc:334] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.059s (SENT)
I20260807 13:33:50.618139 5618 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:50.619171 9223 raft_consensus.cc:2726] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:50.618846 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.620362 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.620877 5771 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 9.
I20260807 13:33:50.621565 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.621932 6638 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:50.631139 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.631737 5545 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:50.632498 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.633101 5545 raft_consensus.cc:2379] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 8: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
W20260807 13:33:50.623140 5618 leader_election.cc:334] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.175s (SENT)
I20260807 13:33:50.633994 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.634771 5555 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
W20260807 13:33:50.637720 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 1.11961e+06us
I20260807 13:33:50.585309 9296 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:50.599069 9277 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:50.643802 5552 raft_consensus.cc:1261] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:50.690166 5543 raft_consensus.cc:2396] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260807 13:33:50.641937 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 434527us
I20260807 13:33:50.681916 9207 raft_consensus.cc:3032] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:33:50.751351 9207 raft_consensus.cc:729] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:50.689640 5548 raft_consensus.cc:1261] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:50.752718 5620 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:50.753116 5548 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8. Ops: []
W20260807 13:33:50.642983 9196 consensus_meta.cc:287] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.515s user 0.010s sys 0.000s
W20260807 13:33:50.732476 5722 connection.cc:232] RPC call timeout handler was delayed by -1.1127463160082698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3189s for a response
I20260807 13:33:50.642266 5618 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:50.641598 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.640319 9042 raft_consensus.cc:2781] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:33:50.755640 9042 raft_consensus.cc:686] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:50.643623 5545 raft_consensus.cc:1226] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:50.694128 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1166) took 1229 ms. Trace:
I20260807 13:33:50.757215 5544 rpcz_store.cc:276] 0807 13:33:49.464902 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:49.466201 (+ 1299us) service_pool.cc:227] Handling call
0807 13:33:49.483377 (+ 17176us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:50.553033 (+1069656us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:50.693835 (+140802us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540025fdd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:50.694042 (+ 207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2445280512}
I20260807 13:33:50.762048 9042 consensus_queue.cc:237] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:50.679097 9311 log.cc:924] Time spent T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.167s user 0.000s sys 0.001s
I20260807 13:33:50.681384 5721 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:50.698868 8464 raft_consensus.cc:3032] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:50.766422 8464 raft_consensus.cc:729] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:50.768267 9061 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 13:33:50.768816 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 316772us
I20260807 13:33:50.771193 5721 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:50.753620 5620 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:50.771503 9277 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:50.717483 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 184309us
I20260807 13:33:50.612313 9293 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:50.769840 9207 consensus_queue.cc:260] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.771899 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:50.800668 5771 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:50.772276 9061 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:50.773571 9304 consensus_queue.cc:1046] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:50.806825 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.774247 5721 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:50.778887 5620 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:50.779390 9282 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:50.809166 9282 raft_consensus.cc:2781] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:50.809652 9282 raft_consensus.cc:686] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:50.810205 5771 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 6.
I20260807 13:33:50.810472 9282 consensus_queue.cc:237] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.811553 6638 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:50.778918 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 155791us
I20260807 13:33:50.779495 5544 raft_consensus.cc:1226] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:50.812762 9277 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:50.813386 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.813747 9277 raft_consensus.cc:686] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:50.814651 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.815464 5544 raft_consensus.cc:2396] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:50.815065 9277 consensus_queue.cc:237] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:50.816007 5618 leader_election.cc:334] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.618s (SENT)
I20260807 13:33:50.788620 5548 raft_consensus.cc:1226] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260807 13:33:50.816565 5618 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:50.780952 9223 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:50.817363 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.818115 5548 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:50.818656 9281 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:50.807472 5556 raft_consensus.cc:3037] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:50.819034 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.819437 5552 raft_consensus.cc:1226] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 3. Current term is 4. Ops: []
I20260807 13:33:50.775894 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:50.821197 5545 raft_consensus.cc:2354] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7.
I20260807 13:33:50.823099 5620 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:50.826382 9207 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:50.831215 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee77ea2bf842b780a8cbcaf0698bc3" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:50.831800 5661 raft_consensus.cc:3037] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:50.792665 5554 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
W20260807 13:33:50.818710 5618 leader_election.cc:334] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.618s (SENT)
I20260807 13:33:50.836570 5618 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:50.792466 9318 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:33:50.835470 8464 consensus_queue.cc:260] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.816323 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.840040 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:50.839919 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.843068 5663 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:50.848776 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.840826 8464 raft_consensus.cc:3037] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:50.846124 9203 raft_consensus.cc:3032] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:50.850195 5556 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:50.850358 9203 raft_consensus.cc:729] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:33:50.811584 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 57059.4us
I20260807 13:33:50.851397 9203 consensus_queue.cc:260] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.853469 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.854324 5545 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
W20260807 13:33:50.857060 5722 leader_election.cc:334] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.504s (SENT)
W20260807 13:33:50.857623 5722 leader_election.cc:334] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.504s (SENT)
W20260807 13:33:50.858989 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 84805us
I20260807 13:33:50.845384 9272 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:50.843923 9281 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
W20260807 13:33:50.878942 5722 leader_election.cc:334] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.515s (SENT)
I20260807 13:33:50.880270 5542 raft_consensus.cc:1261] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:50.879470 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 1181) took 1285 ms. Trace:
W20260807 13:33:50.891646 5722 leader_election.cc:334] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.602s (SENT)
I20260807 13:33:50.891763 9304 consensus_queue.cc:1046] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260807 13:33:50.899928 9061 raft_consensus.cc:3032] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:50.900291 9061 raft_consensus.cc:729] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:50.887449 5554 rpcz_store.cc:276] 0807 13:33:49.593857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:49.954169 (+360312us) service_pool.cc:227] Handling call
0807 13:33:50.879236 (+925067us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400000d54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:50.879392 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1823247104}
I20260807 13:33:50.921439 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.922135 5552 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
W20260807 13:33:50.925724 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 100500us
I20260807 13:33:50.910902 9203 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:50.888365 9318 raft_consensus.cc:686] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:50.943745 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.944484 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:50.945113 5721 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:50.945680 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 58697us
I20260807 13:33:50.910334 9223 raft_consensus.cc:686] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:50.949349 5722 leader_election.cc:334] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.620s (SENT)
I20260807 13:33:50.919354 9272 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:50.956151 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 77461.4us
I20260807 13:33:50.889925 9296 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.956660 5722 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:50.901105 9061 consensus_queue.cc:260] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:50.963348 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:50.955793 9153 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:50.964131 5552 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:50.964391 5620 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:51.319033 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:51.319615 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 355268us
I20260807 13:33:51.128580 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:51.030416 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 211709us
I20260807 13:33:51.114153 5663 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 6.
W20260807 13:33:51.321094 5618 leader_election.cc:334] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.623s (SENT)
I20260807 13:33:51.321139 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.031646 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:51.322001 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 372651us
I20260807 13:33:51.322386 5542 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:33:51.075214 5661 raft_consensus.cc:2454] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 9.
W20260807 13:33:51.323375 5722 leader_election.cc:334] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.730s (SENT)
I20260807 13:33:51.074735 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.323925 5722 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:50.992507 5552 raft_consensus.cc:1203] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Deduplicated request from leader. Original: 2.2->[6.3-6.3] Dedup: 6.3->[]
I20260807 13:33:51.325591 5552 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260807 13:33:51.334615 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.342978 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:51.299813 5390 catalog_manager.cc:5495] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
W20260807 13:33:51.040179 9336 log.cc:924] Time spent T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
W20260807 13:33:50.970614 9329 log.cc:924] Time spent T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.075s user 0.000s sys 0.001s
I20260807 13:33:51.348203 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:51.058553 9299 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:51.351064 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:51.351954 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 221457us
I20260807 13:33:51.354000 5766 raft_consensus.cc:1261] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:51.324563 9061 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:51.354857 5545 raft_consensus.cc:2354] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7.
I20260807 13:33:50.970500 9335 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:51.356375 5771 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 13:33:50.991287 9337 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
W20260807 13:33:51.360406 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 401919us
I20260807 13:33:51.019556 9281 raft_consensus.cc:686] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:50.957839 9272 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:51.351868 5390 catalog_manager.cc:5495] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:51.328900 9339 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:51.273368 9296 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:51.365693 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 44635.5us
W20260807 13:33:51.370270 5618 leader_election.cc:334] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.630s (SENT)
I20260807 13:33:51.370657 5618 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:51.365113 5721 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:51.367272 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:51.371371 5761 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:51.372498 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:51.372594 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:51.368419 5765 raft_consensus.cc:1261] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:51.368783 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.375101 5544 raft_consensus.cc:2379] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:33:51.366329 9293 consensus_meta.cc:287] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.558s user 0.007s sys 0.003s
W20260807 13:33:51.377898 5618 leader_election.cc:334] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.239s (SENT)
I20260807 13:33:51.387040 5721 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:51.332568 9066 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260807 13:33:51.389570 9348 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:51.389886 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:51.373715 8464 consensus_meta.cc:287] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.520s user 0.006s sys 0.004s
I20260807 13:33:51.391901 5658 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:51.392527 5767 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:51.393414 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:51.394366 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:51.397008 5389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51228 (request call id 183) took 13776 ms (client timeout 15000 ms). Trace:
I20260807 13:33:51.397505 5661 raft_consensus.cc:2362] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6. Re-sending same reply.
I20260807 13:33:51.396981 5553 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:51.396593 5665 raft_consensus.cc:2362] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8. Re-sending same reply.
I20260807 13:33:51.400947 5663 raft_consensus.cc:1261] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 13:33:51.373618 9282 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:51.407070 5544 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:51.012367 9223 consensus_queue.cc:237] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:51.377278 5390 catalog_manager.cc:5495] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 2 to 6, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 6 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
W20260807 13:33:51.392026 9207 consensus_meta.cc:287] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.565s user 0.008s sys 0.003s
I20260807 13:33:51.334813 9346 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.064s
I20260807 13:33:51.412827 5659 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:51.413007 5761 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:50.971091 9318 consensus_queue.cc:237] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:51.419901 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:51.420709 5665 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:33:51.422533 6637 leader_election.cc:334] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.806s (SENT)
W20260807 13:33:51.397713 5389 rpcz_store.cc:269] 0807 13:33:37.621143 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:37.621625 (+ 482us) service_pool.cc:227] Handling call
0807 13:33:51.396942 (+13775317us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:49.809005 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:49.912913 (+103908us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:49.912979 (+ 66us) write_op.cc:435] Acquired schema lock
0807 13:33:49.912998 (+ 19us) tablet.cc:660] Decoding operations
0807 13:33:49.953010 (+ 40012us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:49.953114 (+ 104us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:49.953138 (+ 24us) tablet.cc:683] Acquiring locks for 22 operations
0807 13:33:50.060698 (+107560us) tablet.cc:699] Row locks acquired
0807 13:33:50.064422 (+ 3724us) write_op.cc:260] PREPARE: finished
0807 13:33:50.102433 (+ 38011us) write_op.cc:270] Start()
0807 13:33:50.123968 (+ 21535us) write_op.cc:276] Timestamp: P: 1786109630095809 usec, L: 0
0807 13:33:50.128767 (+ 4799us) op_driver.cc:331] REPLICATION: starting
0807 13:33:50.180166 (+ 51399us) log.cc:842] Serialized 8727 byte log entry
0807 13:33:50.507296 (+327130us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff681ff8bee 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551 00007ff682001509 00007ff682001499
0807 13:33:50.596487 (+ 89191us) op_driver.cc:444] REPLICATION: finished
0807 13:33:50.733344 (+136857us) write_op.cc:301] APPLY: starting
0807 13:33:50.733483 (+ 139us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:50.769256 (+ 35773us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:50.769300 (+ 44us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:50.828643 (+ 59343us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:50.829088 (+ 445us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0807 13:33:50.829158 (+ 70us) write_op.cc:312] APPLY: finished
0807 13:33:50.829906 (+ 748us) log.cc:842] Serialized 151 byte log entry
0807 13:33:50.845280 (+ 15374us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:50.853451 (+ 8171us) write_op.cc:454] Released schema lock
0807 13:33:50.859494 (+ 6043us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:50.899942 (+ 40448us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:50.899972 (+ 30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":177058,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":136496,"apply.run_cpu_time_us":7487,"apply.run_wall_time_us":167131,"num_ops":22,"prepare.queue_time_us":297916,"prepare.run_cpu_time_us":39294,"prepare.run_wall_time_us":500221,"raft.queue_time_us":17813,"raft.run_cpu_time_us":62823,"raft.run_wall_time_us":140013,"replication_time_us":467589,"spinlock_wait_cycles":8775936,"thread_start_us":270744,"threads_started":4,"wal-append.queue_time_us":105742}]]}
I20260807 13:33:51.426419 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.426761 5658 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:51.425861 5661 raft_consensus.cc:1226] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:51.429836 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:51.430009 5767 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:51.433372 5499 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:51.421510 8464 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:51.441802 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.442308 5553 raft_consensus.cc:2454] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:51.425419 9347 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:51.446090 5390 catalog_manager.cc:5495] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 3 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 4 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:51.448433 5663 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:33:51.448962 5663 raft_consensus.cc:595] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:51.449252 5663 raft_consensus.cc:603] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:51.413415 9282 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:51.445958 9197 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:51.456308 9197 raft_consensus.cc:686] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:51.457158 9197 consensus_queue.cc:237] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:51.458504 5499 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:51.461004 5543 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:51.433523 9350 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:33:51.451243 9347 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:51.465364 9348 consensus_queue.cc:1035] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:51.464100 9350 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:51.484628 5665 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:33:51.465914 9347 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:51.509217 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.445673 8464 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:51.512012 9361 raft_consensus.cc:2741] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260807 13:33:51.512907 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 125926us
I20260807 13:33:51.479936 9350 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:51.510378 5390 catalog_manager.cc:5495] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 5 to 7, leader changed from d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 7 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:51.516273 9350 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:51.490337 9293 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:33:51.515232 5721 leader_election.cc:302] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:51.527765 5721 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:51.533658 6637 leader_election.cc:334] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.807s (SENT)
I20260807 13:33:51.534716 6637 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:51.435158 9281 consensus_queue.cc:237] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:51.537976 9347 raft_consensus.cc:2726] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:51.542980 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.543572 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.552068 5553 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:51.538661 9277 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:51.561094 9293 raft_consensus.cc:686] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:51.563539 9293 consensus_queue.cc:237] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:51.574986 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.575788 5553 raft_consensus.cc:2379] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:51.553747 9272 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:51.597055 9335 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:33:51.579306 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 97632us
W20260807 13:33:51.561700 9203 consensus_meta.cc:287] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.615s user 0.009s sys 0.001s
I20260807 13:33:51.582966 8464 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:51.558528 9347 raft_consensus.cc:2781] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:51.583732 9282 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:51.574724 9337 raft_consensus.cc:686] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:51.597472 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 166076us
I20260807 13:33:51.600065 5761 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260807 13:33:51.578823 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 166941us
I20260807 13:33:51.610085 5721 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:52.167850 9296 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.778s user 0.051s sys 0.090s
I20260807 13:33:51.625483 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:52.329541 9296 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.940s user 0.052s sys 0.108s
I20260807 13:33:52.329773 9383 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:52.330029 5555 raft_consensus.cc:2362] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 7. Re-sending same reply.
I20260807 13:33:51.662420 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:52.330916 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 720871us
I20260807 13:33:52.331219 5542 raft_consensus.cc:2396] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:51.765264 9339 raft_consensus.cc:686] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:52.332245 5721 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:51.598417 9272 consensus_queue.cc:1046] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.735s
I20260807 13:33:51.804613 5656 raft_consensus.cc:1226] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:52.332541 9339 consensus_queue.cc:237] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.333673 9360 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 13:33:51.737365 5390 catalog_manager.cc:5495] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 3 to 5, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 5 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:51.889752 9368 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:52.337849 9368 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.339092 9360 consensus_queue.cc:1035] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:52.340153 9368 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:52.206027 5499 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.596s user 0.018s sys 0.019s
W20260807 13:33:52.340950 5499 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.733s user 0.021s sys 0.023s
I20260807 13:33:52.341198 5620 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:51.814541 9061 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:52.342227 9061 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:52.343425 5666 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s user 0.004s sys 0.007s
W20260807 13:33:52.343847 5666 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s user 0.004s sys 0.007s
W20260807 13:33:51.868780 5596 heartbeater.cc:644] Failed to heartbeat to 127.3.187.254:34519 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.187.254:34519 timed out after 15.000s (SENT)
I20260807 13:33:52.344872 9061 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:33:52.234220 9346 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s user 0.022s sys 0.033s
I20260807 13:33:52.332697 9337 consensus_queue.cc:237] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.365483 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.870626 5663 raft_consensus.cc:1261] T 5fee77ea2bf842b780a8cbcaf0698bc3 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260807 13:33:52.347138 5618 leader_election.cc:334] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.576s (SENT)
W20260807 13:33:51.617941 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 294583us
I20260807 13:33:51.820483 5665 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 13:33:52.366739 5618 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:52.367725 5722 leader_election.cc:334] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.803s (SENT)
I20260807 13:33:52.368139 5722 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:52.368288 5618 leader_election.cc:334] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.676s (SENT)
I20260807 13:33:51.741827 9347 raft_consensus.cc:686] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:51.627513 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:51.617359 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:52.350382 5620 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:52.253432 9376 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:51.841467 9350 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.355612 5761 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260807 13:33:52.356278 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 750050us
I20260807 13:33:52.363968 9061 raft_consensus.cc:3032] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:33:51.910672 9299 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:51.588191 9377 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.786s
I20260807 13:33:51.642077 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.363456 9383 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:52.363648 9360 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:52.366214 5544 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
W20260807 13:33:52.369171 5618 leader_election.cc:334] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.725s (SENT)
I20260807 13:33:52.369483 5548 raft_consensus.cc:2396] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260807 13:33:52.370995 5721 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:51.621455 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.383641 5543 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:52.364742 5390 catalog_manager.cc:5495] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 3 to 4, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 4 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:52.370385 9372 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 13:33:52.375612 5722 leader_election.cc:334] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.988s (SENT)
I20260807 13:33:52.387200 5722 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:52.367391 9346 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s user 0.022s sys 0.034s
I20260807 13:33:52.389681 9360 raft_consensus.cc:686] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:52.390838 9360 consensus_queue.cc:237] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.377745 9061 raft_consensus.cc:729] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:52.398808 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.389093 5499 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:52.379309 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.401525 9061 consensus_queue.cc:260] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.402937 5548 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:52.405463 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:52.403153 9061 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:52.418386 5722 leader_election.cc:334] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.013s (SENT)
I20260807 13:33:52.420095 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.378278 9207 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:52.381057 5552 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:33:52.420830 5544 raft_consensus.cc:2362] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 5. Re-sending same reply.
I20260807 13:33:52.395208 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.426779 5543 raft_consensus.cc:2396] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260807 13:33:52.406845 5618 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.859s (SENT) [suppressed 90 similar messages]
I20260807 13:33:52.427652 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:52.428598 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.429205 5548 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
W20260807 13:33:52.410418 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 45856.9us
I20260807 13:33:52.402382 5545 raft_consensus.cc:2396] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:52.422248 5499 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:52.423615 5764 raft_consensus.cc:1261] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260807 13:33:52.425033 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 43491.7us
W20260807 13:33:52.431939 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 58214.4us
I20260807 13:33:52.454241 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.457945 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.417446 9377 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:52.387410 9358 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:52.460888 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.379997 9293 consensus_queue.cc:1046] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260807 13:33:52.469111 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.424506 9272 raft_consensus.cc:2741] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260807 13:33:52.471195 5722 leader_election.cc:334] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.070s (SENT)
I20260807 13:33:52.471279 5665 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:33:52.373143 9376 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.430377 9389 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:52.476362 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 45008.1us
I20260807 13:33:52.486544 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.488132 5721 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:52.473450 5722 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:52.476799 9347 consensus_queue.cc:237] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.476963 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:52.511618 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.512888 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.485412 9350 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:52.515547 9350 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:52.515915 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1634) took 1139 ms. Trace:
I20260807 13:33:52.486159 5548 raft_consensus.cc:2379] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 3: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:52.516660 5656 rpcz_store.cc:276] 0807 13:33:51.376415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:51.376576 (+ 161us) service_pool.cc:227] Handling call
0807 13:33:51.376929 (+ 353us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:52.333772 (+956843us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:52.515611 (+181839us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54000e3dd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:52.515819 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":982973312}
I20260807 13:33:52.517647 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.518447 5548 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:52.519397 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:52.520584 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.521396 5548 raft_consensus.cc:2379] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:52.521853 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.473805 5665 raft_consensus.cc:595] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:52.522655 5665 raft_consensus.cc:603] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:52.523252 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.524601 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.525319 5554 raft_consensus.cc:2454] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:52.527112 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.527840 5553 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:52.529557 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1644) took 1108 ms. Trace:
I20260807 13:33:52.515975 9350 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:52.536921 5543 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:52.382175 9299 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.530022 5659 rpcz_store.cc:276] 0807 13:33:51.420940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:51.421509 (+ 569us) service_pool.cc:227] Handling call
0807 13:33:52.529335 (+1107826us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000ab254. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:52.529489 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2350551424}
I20260807 13:33:52.538268 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.522675 5542 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:33:52.539098 5553 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 13:33:52.539719 5554 raft_consensus.cc:1226] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:52.543244 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:52.544060 5764 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:52.545521 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.461624 9354 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:52.551462 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.552127 5555 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:52.549593 5552 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:52.549455 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.553864 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:52.554528 5556 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:52.590461 5545 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
W20260807 13:33:52.548110 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 91992us
I20260807 13:33:52.603338 5543 raft_consensus.cc:1226] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:52.471832 9390 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:33:52.534960 9405 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:52.607859 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 58384.1us
I20260807 13:33:52.538992 9350 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:52.610700 9405 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:52.476598 9410 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.152s
I20260807 13:33:52.613554 9405 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:52.616511 5771 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:52.558898 9318 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:52.627694 5620 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:52.589900 9364 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:52.631724 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 224902us
W20260807 13:33:52.637005 5618 connection.cc:232] RPC call timeout handler was delayed by -1.175685458118096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3709s for a response
I20260807 13:33:52.553244 9358 raft_consensus.cc:686] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:52.630067 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 198142us
W20260807 13:33:52.657527 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 120811us
W20260807 13:33:52.656569 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 233237us
I20260807 13:33:52.604261 9421 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:33:52.661720 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 205332us
W20260807 13:33:52.668524 5722 leader_election.cc:334] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.121s (SENT)
I20260807 13:33:52.668936 5722 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:52.672345 5618 leader_election.cc:334] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.640s (SENT)
W20260807 13:33:52.670514 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 182416us
W20260807 13:33:52.673221 5618 leader_election.cc:334] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.671s (SENT)
I20260807 13:33:52.673628 5618 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:52.608038 9346 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.052s
I20260807 13:33:52.559516 9183 consensus_queue.cc:1046] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260807 13:33:52.535112 9389 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:52.690577 5618 leader_election.cc:334] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.712s (SENT)
I20260807 13:33:52.695590 5618 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:52.697067 5618 leader_election.cc:334] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.783s (SENT)
I20260807 13:33:52.697543 5618 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:52.698675 5618 leader_election.cc:334] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.828s (SENT)
W20260807 13:33:52.680047 6637 leader_election.cc:334] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.247s (SENT)
I20260807 13:33:52.699523 6637 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:52.701145 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 91181.6us
W20260807 13:33:52.707783 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 52049.6us
I20260807 13:33:52.630472 9353 consensus_queue.cc:1035] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260807 13:33:52.711594 5771 raft_consensus.cc:595] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:52.655433 9364 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:52.719640 9396 log.cc:924] Time spent T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.185s user 0.000s sys 0.001s
I20260807 13:33:52.723162 9183 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:52.723039 9420 consensus_queue.cc:1046] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260807 13:33:52.724004 5618 leader_election.cc:334] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.855s (SENT)
I20260807 13:33:52.675105 9337 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:52.701480 9404 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260807 13:33:52.632805 9318 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.700377 9368 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:52.703060 9296 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:52.700296 9405 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260807 13:33:52.710814 9282 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:52.724169 9359 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:52.703135 9042 consensus_queue.cc:1046] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260807 13:33:52.788436 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:52.795420 9377 raft_consensus.cc:686] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:52.796516 9377 consensus_queue.cc:237] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:52.798678 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 364631us
W20260807 13:33:52.780464 9401 log.cc:924] Time spent T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.170s user 0.001s sys 0.000s
W20260807 13:33:52.810856 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 86874.4us
W20260807 13:33:52.815219 5618 leader_election.cc:334] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.895s (SENT)
W20260807 13:33:52.811832 9403 log.cc:924] Time spent T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.340s user 0.001s sys 0.000s
I20260807 13:33:52.813220 9389 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:52.822221 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:52.783588 9420 consensus_queue.cc:1225] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 0b9aca0aafaa43e7998ee8f3e59627e0 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260807 13:33:52.834511 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:52.784584 9299 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:52.783059 9337 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:52.779572 9358 consensus_queue.cc:237] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:52.900038 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:52.900725 5661 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 7.
I20260807 13:33:52.901466 9337 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:52.902164 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 86985.5us
W20260807 13:33:52.902319 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 65004.2us
W20260807 13:33:52.902864 5618 leader_election.cc:334] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.946s (SENT)
W20260807 13:33:52.898327 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 70341.9us
I20260807 13:33:52.910154 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:52.911463 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 1227) took 1228 ms. Trace:
I20260807 13:33:52.911857 5552 rpcz_store.cc:276] 0807 13:33:51.683063 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:52.512599 (+829536us) service_pool.cc:227] Handling call
0807 13:33:52.911253 (+398654us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b540016e754. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:52.911398 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":82621824}
W20260807 13:33:52.913705 9425 log.cc:924] Time spent T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.191s user 0.001s sys 0.000s
W20260807 13:33:52.916339 5618 leader_election.cc:334] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.978s (SENT)
I20260807 13:33:52.917460 5618 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:52.907084 9403 log.cc:924] Time spent T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
W20260807 13:33:52.921427 5501 connection.cc:232] RPC call timeout handler was delayed by -3.6643836619332433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260807 13:33:52.921868 5501 connection.cc:232] RPC call timeout handler was delayed by -3.6256836620159447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260807 13:33:52.922192 5501 connection.cc:232] RPC call timeout handler was delayed by -3.6247836619149894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260807 13:33:52.922482 5501 connection.cc:232] RPC call timeout handler was delayed by -3.5878836619667709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260807 13:33:52.922749 5501 connection.cc:232] RPC call timeout handler was delayed by -3.5500836619175971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260807 13:33:52.923026 5501 connection.cc:232] RPC call timeout handler was delayed by -3.5365836618002504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260807 13:33:52.923301 5501 connection.cc:232] RPC call timeout handler was delayed by -3.5059836618602276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260807 13:33:52.923550 5501 connection.cc:232] RPC call timeout handler was delayed by -3.4852836618665606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260807 13:33:52.923794 5501 connection.cc:232] RPC call timeout handler was delayed by -3.4618836618028581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260807 13:33:52.924041 5501 connection.cc:232] RPC call timeout handler was delayed by -3.4411836618091911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260807 13:33:52.924301 5501 connection.cc:232] RPC call timeout handler was delayed by -3.2998836617916822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260807 13:33:52.924551 5501 connection.cc:232] RPC call timeout handler was delayed by -3.2332836620043963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260807 13:33:52.924821 5501 connection.cc:232] RPC call timeout handler was delayed by -3.2332836620043963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260807 13:33:52.925081 5501 connection.cc:232] RPC call timeout handler was delayed by -3.2269836619962007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260807 13:33:52.925340 5501 connection.cc:232] RPC call timeout handler was delayed by -3.2197836618870497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260807 13:33:52.925609 5501 connection.cc:232] RPC call timeout handler was delayed by -3.1729836619924754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
I20260807 13:33:52.926880 9451 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:52.836491 9376 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:52.933524 9183 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:52.935452 9351 raft_consensus.cc:3032] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:33:52.935817 9351 raft_consensus.cc:729] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:52.939719 9318 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:52.941470 9214 raft_consensus.cc:3032] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:52.941871 9214 raft_consensus.cc:729] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:52.942737 9214 consensus_queue.cc:260] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:52.943958 9061 consensus_meta.cc:287] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.526s user 0.007s sys 0.003s
W20260807 13:33:52.945205 9441 log.cc:924] Time spent T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.223s user 0.000s sys 0.001s
I20260807 13:33:52.944057 9214 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:52.944733 9416 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260807 13:33:52.925874 5501 connection.cc:232] RPC call timeout handler was delayed by -3.0955836619250476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260807 13:33:52.952286 5501 connection.cc:232] RPC call timeout handler was delayed by -2.9488836620002985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2363s for a response
W20260807 13:33:52.952687 5501 connection.cc:232] RPC call timeout handler was delayed by -2.9470836617983878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23650000000000004s for a response
W20260807 13:33:52.953030 5501 connection.cc:232] RPC call timeout handler was delayed by -2.8876836618874222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2431s for a response
W20260807 13:33:52.953168 5618 leader_election.cc:334] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.986s (SENT)
W20260807 13:33:52.951601 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 44080.3us
I20260807 13:33:52.953590 5618 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:52.956528 9296 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:52.957195 9296 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:52.961335 9409 raft_consensus.cc:3032] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:52.961755 9409 raft_consensus.cc:729] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:52.962637 9409 consensus_queue.cc:260] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:52.963948 9409 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:52.966869 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:52.967527 5762 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 6.
I20260807 13:33:52.968465 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:52.953395 5501 connection.cc:232] RPC call timeout handler was delayed by -2.81298366189003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2514s for a response
W20260807 13:33:52.971791 5501 connection.cc:232] RPC call timeout handler was delayed by -2.6914836619980633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2649s for a response
W20260807 13:33:52.972500 5501 connection.cc:232] RPC call timeout handler was delayed by -2.5087836619932204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2852s for a response
W20260807 13:33:52.972743 5618 leader_election.cc:334] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.987s (SENT)
I20260807 13:33:52.973206 5618 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:52.975085 5499 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:52.975205 6636 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:52.977802 9449 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 13:33:52.978088 5618 leader_election.cc:334] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.018s (SENT)
I20260807 13:33:52.972226 9281 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 13:33:52.979281 5618 leader_election.cc:334] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.058s (SENT)
W20260807 13:33:52.980036 5618 leader_election.cc:334] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.077s (SENT)
W20260807 13:33:52.980752 5618 leader_election.cc:334] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.081s (SENT)
I20260807 13:33:52.982419 9447 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:33:52.984305 5618 leader_election.cc:334] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 3.165s (SENT)
I20260807 13:33:52.984728 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:52.985519 5620 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:52.951516 9350 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.001713 5661 raft_consensus.cc:1261] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:53.006454 5618 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:53.007380 5659 raft_consensus.cc:1226] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:53.002353 9346 consensus_queue.cc:1035] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260807 13:33:53.008778 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.009694 5771 raft_consensus.cc:2396] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260807 13:33:53.010023 9346 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:52.994522 9348 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:33:53.012908 9398 log.cc:924] Time spent T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.544s user 0.002s sys 0.000s
I20260807 13:33:52.994359 9337 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:53.021096 9449 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:53.022202 9438 consensus_queue.cc:1046] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:53.023702 9438 raft_consensus.cc:3032] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:53.024029 9438 raft_consensus.cc:729] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:53.024395 9390 raft_consensus.cc:686] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:53.024811 9438 consensus_queue.cc:260] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.015758 9409 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:53.040347 9360 consensus_queue.cc:1035] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:53.041927 9359 consensus_queue.cc:1035] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:53.047374 9390 consensus_queue.cc:237] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.048460 9461 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:53.049363 9296 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.052214 9296 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:53.054693 5501 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:53.055235 9461 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 13:33:53.049592 9444 log.cc:924] Time spent T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.107s user 0.003s sys 0.000s
I20260807 13:33:53.055590 9350 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:53.059836 9368 consensus_queue.cc:1035] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:53.039017 9409 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:53.062171 9438 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:53.059953 9351 consensus_queue.cc:260] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:53.067238 5659 raft_consensus.cc:1226] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:53.071565 9377 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:33:53.072630 5767 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
W20260807 13:33:53.073925 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 405398us
W20260807 13:33:53.074687 5722 leader_election.cc:334] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.152s (SENT)
I20260807 13:33:53.075029 5722 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:53.078437 5501 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:53.080520 5722 leader_election.cc:334] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.202s (SENT)
I20260807 13:33:53.081132 5722 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:53.066749 5660 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:53.062624 9339 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:53.086218 9421 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:53.086549 9339 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:53.063568 9368 consensus_queue.cc:1225] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer 14f62bf285c448b9b7a21fabd7a5f0bf log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:33:53.069419 9223 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:53.070951 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:53.069080 5618 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:53.092468 5763 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:53.065135 9409 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:33:53.090135 5722 connection.cc:232] RPC call timeout handler was delayed by -2.1862723650410771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
I20260807 13:33:53.097162 9299 raft_consensus.cc:2726] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:53.088624 9377 consensus_queue.cc:1046] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260807 13:33:53.098117 9352 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:53.093228 9347 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:53.098858 5767 raft_consensus.cc:595] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:53.100437 6680 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:53.122066 5767 raft_consensus.cc:603] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:53.100570 5771 raft_consensus.cc:1261] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 13:33:53.103242 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.123416 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.124174 9364 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:53.105465 8464 raft_consensus.cc:3032] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:53.124382 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.105906 6694 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260807 13:33:53.111966 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.109920 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 1067) took 1367 ms. Trace:
I20260807 13:33:53.124658 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.119483 9352 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:53.120805 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 51781.4us
I20260807 13:33:53.121328 9337 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:53.087929 9461 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:53.124763 8464 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:53.125650 5548 rpcz_store.cc:276] 0807 13:33:51.742588 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:52.539051 (+796463us) service_pool.cc:227] Handling call
0807 13:33:53.109130 (+570079us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54003976d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:53.109838 (+ 708us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":882927872}
I20260807 13:33:53.129487 5618 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:33:53.129552 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 51187.5us
I20260807 13:33:53.130492 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:53.134721 5770 raft_consensus.cc:2354] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:33:53.130597 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:53.141654 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.142987 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.143647 5770 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:53.144546 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:53.149238 5501 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:53.151917 5620 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:53.165347 5770 raft_consensus.cc:1261] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:33:53.166436 5771 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:53.171432 5770 raft_consensus.cc:1261] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 13:33:53.181865 5771 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:53.151904 9438 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:53.187263 5770 raft_consensus.cc:1261] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260807 13:33:53.194626 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 85254.7us
W20260807 13:33:53.199855 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 50706.7us
W20260807 13:33:53.200028 5722 connection.cc:232] RPC call timeout handler was delayed by -2.13765538088046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260807 13:33:53.200691 5722 connection.cc:232] RPC call timeout handler was delayed by -2.1244807557668537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
W20260807 13:33:53.201540 5722 leader_election.cc:334] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.570s (SENT)
I20260807 13:33:53.201930 5722 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:53.202971 5722 leader_election.cc:334] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.595s (SENT)
I20260807 13:33:53.203379 5722 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:53.204878 5618 leader_election.cc:334] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.803s (SENT)
W20260807 13:33:53.205564 5618 leader_election.cc:334] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.950s (SENT)
I20260807 13:33:53.166018 9358 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:53.200850 5763 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:53.141330 9368 consensus_queue.cc:1035] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.049s
I20260807 13:33:53.141177 9377 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260807 13:33:53.178050 9447 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:53.224864 5722 leader_election.cc:334] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.363s (SENT)
I20260807 13:33:53.226408 5722 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:53.224810 5763 raft_consensus.cc:1261] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260807 13:33:53.228070 5763 pending_rounds.cc:76] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 3
I20260807 13:33:53.228358 5763 pending_rounds.cc:97] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260807 13:33:53.228633 5763 raft_consensus.cc:2866] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:53.239876 5770 raft_consensus.cc:1261] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:53.176578 9296 consensus_queue.cc:1035] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260807 13:33:53.270560 5765 raft_consensus.cc:1226] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:53.218446 9347 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:53.274263 5763 raft_consensus.cc:1261] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:53.277766 5501 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:53.193974 9359 consensus_queue.cc:1035] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
W20260807 13:33:53.315371 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 90521.9us
W20260807 13:33:53.316030 5722 connection.cc:232] RPC call timeout handler was delayed by -1.9737024719361216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2756s for a response
W20260807 13:33:53.316613 5722 leader_election.cc:334] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.459s (SENT)
I20260807 13:33:53.317068 5722 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:53.217543 9360 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260807 13:33:53.206797 9364 consensus_queue.cc:1035] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260807 13:33:53.254571 9299 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:33:53.186708 8464 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.326261 8464 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:53.327232 9352 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:53.327680 9411 log.cc:924] Time spent T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.617s user 0.002s sys 0.000s
I20260807 13:33:53.184345 9423 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.148s
I20260807 13:33:53.277906 9421 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:53.329785 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:53.335471 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 118698us
I20260807 13:33:53.337669 5620 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:53.339897 5722 connection.cc:232] RPC call timeout handler was delayed by -1.9555702919606119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260807 13:33:53.340617 5722 connection.cc:232] RPC call timeout handler was delayed by -1.8072024718858302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2941s for a response
W20260807 13:33:53.340927 5722 connection.cc:232] RPC call timeout handler was delayed by -1.3557643820531666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2619s for a response
I20260807 13:33:53.350162 9299 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 13:33:53.350538 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 109144us
I20260807 13:33:53.336604 9376 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 13:33:53.332686 9459 log.cc:924] Time spent T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
I20260807 13:33:53.359817 9421 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:53.366856 9223 raft_consensus.cc:2781] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
W20260807 13:33:53.384634 9466 log.cc:924] Time spent T 00000000000000000000000000000000 P a9f384d8e9094a008ffb096177d1785c: Append to log took a long time: real 0.308s user 0.002s sys 0.000s
W20260807 13:33:53.369470 9472 log.cc:924] Time spent T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.192s user 0.000s sys 0.001s
W20260807 13:33:53.370448 9467 log.cc:924] Time spent T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.151s user 0.001s sys 0.000s
W20260807 13:33:53.371366 9413 log.cc:924] Time spent T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.693s user 0.000s sys 0.003s
W20260807 13:33:53.373648 9481 log.cc:924] Time spent T 5fee77ea2bf842b780a8cbcaf0698bc3 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
W20260807 13:33:53.374267 9452 log.cc:924] Time spent T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260807 13:33:53.366123 9455 raft_consensus.cc:3032] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:53.358110 9347 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:53.382150 9410 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:53.382449 9493 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:53.382952 9421 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.255723 9447 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.391786 5501 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:53.392338 9455 raft_consensus.cc:729] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:53.378079 9376 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:53.400388 9495 consensus_queue.cc:1035] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260807 13:33:53.400665 9410 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:53.392207 9223 raft_consensus.cc:686] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:53.409323 9377 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:53.472627 9351 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:53.388057 9389 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260807 13:33:53.408545 9493 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.410571 9376 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
W20260807 13:33:53.441579 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 53614.6us
I20260807 13:33:53.442773 9447 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:53.443933 9410 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:53.498684 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:53.499542 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:53.499836 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:53.500181 5667 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:53.500329 9318 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:53.501080 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:53.501633 5667 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:53.503504 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:53.503774 5618 leader_election.cc:334] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.088s (SENT)
I20260807 13:33:53.504663 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:53.505218 5666 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:53.506220 5721 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:53.507413 9493 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:53.508550 5663 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:53.509117 9339 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:53.498327 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:53.511010 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:53.511745 5656 raft_consensus.cc:2379] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:53.513513 5656 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:53.444245 9421 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:53.417562 9423 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:53.444994 9409 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:53.458807 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 70164.7us
I20260807 13:33:53.403734 9299 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260807 13:33:53.458547 9455 consensus_queue.cc:260] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.460284 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 13:33:53.474795 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.401684 9347 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.480306 9223 consensus_queue.cc:237] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.497222 5501 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:53.497394 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:53.505968 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:53.524678 5663 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:53.528225 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:33:53.530961 5666 raft_consensus.cc:2379] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:53.531302 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:33:53.529127 6694 raft_consensus.cc:2354] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
I20260807 13:33:53.556751 5656 raft_consensus.cc:1261] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:53.555774 5667 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:53.559989 5667 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260807 13:33:53.571133 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 77920.5us
I20260807 13:33:53.579397 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.584398 5770 raft_consensus.cc:1261] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:53.560281 9389 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:53.586486 5501 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:53.592727 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.593869 5770 raft_consensus.cc:2379] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:53.582581 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:53.598229 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:53.598815 5660 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:53.599289 9347 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:53.596686 9389 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:53.604442 9409 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:53.606282 5501 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:53.607275 9461 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:53.607671 5501 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:53.608569 9461 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:53.588228 9214 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260807 13:33:53.623911 9390 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:53.625859 5501 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:53.616958 5660 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
I20260807 13:33:53.631482 5662 raft_consensus.cc:1226] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260807 13:33:53.632261 9390 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:53.635893 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:53.637733 6692 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:53.639175 9376 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.646059 9214 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 13:33:53.652168 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:53.652899 5660 raft_consensus.cc:2354] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5.
I20260807 13:33:53.658648 5725 leader_election.cc:398] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077) with higher term. Message: Invalid argument: T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
I20260807 13:33:53.658948 5725 leader_election.cc:401] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:33:53.660917 9461 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:53.661556 9461 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.664077 5499 leader_election.cc:398] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5.
I20260807 13:33:53.664481 5499 leader_election.cc:401] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260807 13:33:53.652410 9389 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:53.666759 9461 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:53.666529 9389 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:53.669325 9376 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:53.670186 9389 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:53.669927 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:53.685302 5764 raft_consensus.cc:1261] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:53.687098 9461 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:53.687774 9438 raft_consensus.cc:3032] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:33:53.688207 9438 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:53.679566 9318 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:53.689023 9438 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:53.689729 9318 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:53.690722 9455 raft_consensus.cc:3037] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:53.694063 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 204807us
I20260807 13:33:53.694365 9438 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:33:53.704248 5722 leader_election.cc:334] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.774s (SENT)
I20260807 13:33:53.705722 5722 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:53.708123 5501 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:53.703285 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 49383.2us
I20260807 13:33:53.718153 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:53.718868 5665 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:53.721057 5501 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:53.723263 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 217101us
I20260807 13:33:53.724182 5721 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:53.727747 5501 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:53.715864 9461 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:53.734189 5501 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:53.731961 5499 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:53.738483 9433 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:53.742254 5501 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:53.724895 9376 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 13:33:53.748530 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 44332.9us
I20260807 13:33:53.730383 9421 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:53.753033 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:53.753710 5764 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:53.729408 9389 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:33:53.749922 5722 leader_election.cc:334] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.888s (SENT)
I20260807 13:33:53.756613 5722 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:33:53.755822 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 103774us
I20260807 13:33:53.736640 9420 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:53.764804 5721 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:53.765972 5620 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:53.747550 8464 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:53.770359 9352 consensus_queue.cc:1035] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:53.751789 9423 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:33:53.770841 5722 leader_election.cc:334] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.157s (SENT)
I20260807 13:33:53.779795 5722 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:53.753289 9421 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:53.736918 9377 consensus_queue.cc:1046] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260807 13:33:53.817989 5764 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
I20260807 13:33:53.807519 9421 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:53.757084 9433 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:53.763235 9348 consensus_queue.cc:1035] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260807 13:33:53.815498 9350 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:53.776854 9383 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:53.788283 9497 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:53.771915 9299 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260807 13:33:53.818260 9377 raft_consensus.cc:3032] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:33:53.884948 9377 raft_consensus.cc:729] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:53.885133 9422 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077) with higher term. Message: Invalid argument: T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
I20260807 13:33:53.886196 9377 consensus_queue.cc:260] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:53.888320 9377 raft_consensus.cc:3037] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:53.772092 8464 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:53.894351 8464 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:53.895655 9272 raft_consensus.cc:3032] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:33:53.896014 9272 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:53.896727 9272 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:53.883903 9504 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:53.906764 9504 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:53.768635 9458 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:53.822371 6638 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:53.913319 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 91297.4us
W20260807 13:33:53.875700 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 133509us
I20260807 13:33:53.914258 5501 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:53.876694 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 105883us
W20260807 13:33:53.882586 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 61474.6us
I20260807 13:33:53.919231 5501 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:53.926134 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 161358us
I20260807 13:33:53.927357 5721 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:53.914819 9458 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:53.822214 9354 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
W20260807 13:33:54.042564 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 123398us
I20260807 13:33:54.087360 5501 leader_election.cc:398] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:33:53.926710 9438 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 13:33:54.009910 9527 log.cc:924] Time spent T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.268s user 0.000s sys 0.002s
W20260807 13:33:54.091879 5722 leader_election.cc:334] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.619s (SENT)
I20260807 13:33:53.916478 9449 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:54.094012 5501 leader_election.cc:401] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260807 13:33:53.948704 9347 raft_consensus.cc:2781] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:54.000524 9321 raft_consensus.cc:2781] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:33:53.961263 9458 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:54.098613 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:54.014475 9504 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:54.031394 9272 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:54.104826 5501 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:54.098517 8464 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.109361 9438 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:54.109537 9299 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:54.110049 9536 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:54.110075 5722 leader_election.cc:334] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.756s (SENT)
I20260807 13:33:54.129053 5722 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:54.090234 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:54.139706 6692 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
W20260807 13:33:54.141335 5722 leader_election.cc:334] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.941s (SENT)
I20260807 13:33:54.141758 5722 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:54.157836 5767 raft_consensus.cc:1261] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 13:33:54.025346 9318 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.108378 9207 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:54.125700 9543 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:54.130740 9449 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:54.131026 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.131990 9347 raft_consensus.cc:686] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:54.132848 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.133334 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.133471 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.134083 9299 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.134851 9455 consensus_queue.cc:1035] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:54.095537 9354 raft_consensus.cc:686] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:54.139019 9376 consensus_queue.cc:1035] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:54.144209 9383 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:33:54.159787 9535 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:54.000742 9501 consensus_queue.cc:1035] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.193s
I20260807 13:33:54.097226 9461 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5.
I20260807 13:33:54.166698 5621 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:54.138278 9536 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.172633 5556 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
I20260807 13:33:54.176919 5545 raft_consensus.cc:2379] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:54.194223 5552 raft_consensus.cc:1226] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:54.206820 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.207780 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.208586 5545 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 5.
I20260807 13:33:54.175199 9207 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.218025 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.220965 5552 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:54.227174 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.211755 9364 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:54.211969 9421 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.210822 9347 consensus_queue.cc:237] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.237553 9421 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:54.274782 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:54.275303 5661 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:54.272819 5552 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:54.282151 5552 raft_consensus.cc:1261] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:54.282861 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.231950 9364 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:54.297153 5661 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:33:54.299786 5721 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:54.283779 9517 log.cc:924] Time spent T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
I20260807 13:33:54.303548 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.315762 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.316313 5552 raft_consensus.cc:2379] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:54.316649 5556 raft_consensus.cc:2396] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 13:33:54.281134 8464 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:54.308919 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 105733us
I20260807 13:33:54.290948 9364 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:54.312551 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:54.281901 9438 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:33:54.217322 9354 consensus_queue.cc:237] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.318023 5661 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:33:54.335613 5721 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:54.339313 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.339905 5556 raft_consensus.cc:2362] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3. Re-sending same reply.
I20260807 13:33:54.341321 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.308533 9061 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:33:54.350553 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.351054 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.351397 5556 raft_consensus.cc:2396] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260807 13:33:54.351670 5542 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:54.352284 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.356204 9318 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:54.356869 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.358855 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.335440 9551 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:54.404421 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 66253.6us
I20260807 13:33:54.339398 9536 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:54.343935 9207 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:54.369534 5544 raft_consensus.cc:3032] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:54.408967 5544 raft_consensus.cc:729] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:54.374477 5555 raft_consensus.cc:2396] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260807 13:33:54.342427 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.411442 5553 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:54.412364 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.381503 5556 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:54.414011 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.386552 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.314575 9299 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:54.414731 5556 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:54.416911 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.417445 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.418327 5556 raft_consensus.cc:2354] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6.
I20260807 13:33:54.419127 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:54.418349 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 82838.3us
I20260807 13:33:54.413041 5553 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:54.423411 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.426465 5553 raft_consensus.cc:2362] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5. Re-sending same reply.
I20260807 13:33:54.427378 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.428536 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.435525 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:54.436275 5770 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:54.405109 9545 log.cc:924] Time spent T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20260807 13:33:54.443274 5552 raft_consensus.cc:2379] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:54.450693 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.450814 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.451603 5769 raft_consensus.cc:2354] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8.
I20260807 13:33:54.452185 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.452360 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:54.452944 5769 raft_consensus.cc:2362] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7. Re-sending same reply.
I20260807 13:33:54.453390 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.450639 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:54.416889 9544 log.cc:924] Time spent T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.061s user 0.000s sys 0.001s
I20260807 13:33:54.455811 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.456946 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.414985 9551 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:54.464548 5556 raft_consensus.cc:2454] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:54.466130 5556 raft_consensus.cc:1261] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:33:54.443171 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.473640 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:54.467962 5553 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:54.409906 5544 consensus_queue.cc:260] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.459400 9410 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:54.482375 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.497816 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.498092 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.447752 9421 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:33:54.514430 9421 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:54.514847 9421 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:54.441926 9061 raft_consensus.cc:686] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:54.519042 9061 consensus_queue.cc:237] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.513358 5544 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:54.511022 9410 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:54.525239 9410 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:54.525627 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.526444 5766 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
I20260807 13:33:54.474218 9538 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260807 13:33:54.527770 6638 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:54.528780 9410 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:33:54.529234 9410 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:54.529618 9410 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:54.534286 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.536087 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:54.539253 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:54.540524 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.541164 5767 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
I20260807 13:33:54.542706 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.443907 9318 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.091s
I20260807 13:33:54.544530 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:54.457993 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.563141 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:54.563877 5544 raft_consensus.cc:1261] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 13:33:54.563875 5767 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 6
W20260807 13:33:54.488746 9555 log.cc:924] Time spent T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.132s user 0.000s sys 0.001s
I20260807 13:33:54.596097 5767 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:54.597651 5767 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 13:33:54.572717 5770 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:54.571700 6637 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:54.600078 5763 raft_consensus.cc:1226] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:54.603502 5762 raft_consensus.cc:1226] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:54.605991 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:54.606585 5665 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:54.597604 5542 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:54.608686 5556 raft_consensus.cc:1261] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260807 13:33:54.611537 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 236220us
I20260807 13:33:54.629244 5665 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:54.628712 9214 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:54.619658 9438 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:54.620081 8464 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:54.627725 9504 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:54.627722 9321 raft_consensus.cc:686] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:54.693310 5545 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:54.697474 5543 raft_consensus.cc:1261] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:33:54.685158 9376 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:54.692726 9549 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:54.703840 9551 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:54.687696 9214 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:54.727171 5722 leader_election.cc:334] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.650s (SENT)
I20260807 13:33:54.727626 5722 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:54.697203 9364 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:54.692832 9438 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:54.697657 8464 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:54.698993 9504 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:54.736255 9354 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:54.718667 9376 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.729975 9543 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:54.764706 5501 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:54.771047 5763 raft_consensus.cc:1226] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
W20260807 13:33:54.766331 9458 consensus_meta.cc:287] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.639s user 0.011s sys 0.000s
W20260807 13:33:54.780751 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 160062us
W20260807 13:33:54.791175 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 45476.1us
I20260807 13:33:54.794816 5501 leader_election.cc:398] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8.
I20260807 13:33:54.825177 5766 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:54.825526 5620 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:54.773821 9543 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:54.825043 5618 leader_election.cc:334] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 3.125s (SENT)
I20260807 13:33:54.791878 9458 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.773556 9321 consensus_queue.cc:237] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:54.857231 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 120346us
I20260807 13:33:54.842614 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:54.873301 5665 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 6.
I20260807 13:33:54.870998 5618 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:54.875811 6636 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:54.895742 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 52239.1us
I20260807 13:33:54.896591 5501 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:54.832417 9576 log.cc:924] Time spent T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.108s user 0.000s sys 0.001s
I20260807 13:33:54.899780 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.900590 5554 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:54.901423 5766 raft_consensus.cc:1226] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260807 13:33:54.876595 9575 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:54.877530 9214 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:54.912904 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:54.891582 9438 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:54.922379 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:54.920753 6694 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:54.928081 5503 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:54.898351 9364 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:54.930306 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 105573us
W20260807 13:33:54.934270 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 112312us
I20260807 13:33:54.908623 8464 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:54.937739 5618 leader_election.cc:334] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 3.139s (SENT)
I20260807 13:33:54.919324 9575 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:54.910384 9504 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:54.944929 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:54.938709 5501 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:54.906395 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:54.942873 5618 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:54.939422 9501 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:54.933211 9214 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:54.930632 9223 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260807 13:33:54.935403 9572 log.cc:924] Time spent T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.177s user 0.001s sys 0.000s
I20260807 13:33:54.972777 5665 raft_consensus.cc:1261] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 13:33:54.959636 9581 log.cc:924] Time spent T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.103s user 0.000s sys 0.001s
I20260807 13:33:54.930619 9376 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:54.968336 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:55.005715 9449 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:54.981623 5618 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:54.983328 9560 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:54.970295 8464 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:54.983952 9493 consensus_queue.cc:1035] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:33:54.985904 9421 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:54.945314 9575 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:54.987524 9501 raft_consensus.cc:686] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:33:55.035068 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 96446.5us
I20260807 13:33:55.007633 5665 raft_consensus.cc:1261] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 13:33:54.980912 9543 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:54.943616 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:55.024104 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:55.075754 5722 leader_election.cc:334] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.964s (SENT)
I20260807 13:33:55.076261 5722 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:55.088445 6692 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:55.088691 9575 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:55.090003 6680 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
W20260807 13:33:55.090879 9589 log.cc:924] Time spent T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.188s user 0.000s sys 0.003s
I20260807 13:33:55.092556 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:55.093340 5555 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:55.094139 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:55.094715 5555 raft_consensus.cc:2362] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 5. Re-sending same reply.
I20260807 13:33:55.095541 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.096531 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.097709 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.099047 5555 raft_consensus.cc:2379] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:55.099687 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.100430 5555 raft_consensus.cc:2396] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:55.101082 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:55.101548 5555 raft_consensus.cc:3037] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:55.028477 5554 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
W20260807 13:33:55.030021 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 48490.5us
I20260807 13:33:55.030766 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:54.981943 9458 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:54.989710 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.106609 5661 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:55.110723 5542 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 7.
I20260807 13:33:55.111549 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.111703 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:55.112119 5542 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:55.112885 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.051878 9421 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:55.028932 8464 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:55.058598 9501 consensus_queue.cc:237] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:55.035573 9595 raft_consensus.cc:2741] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260807 13:33:54.968796 9410 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:55.065474 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.065802 9549 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:55.067759 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.067821 5501 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:55.070194 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:55.106746 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.122973 5658 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:55.107198 5618 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:55.118717 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:55.121526 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.124810 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.164244 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.165063 5552 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
W20260807 13:33:55.125502 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 49789.7us
I20260807 13:33:55.131687 5554 raft_consensus.cc:2379] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:55.166031 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.124135 5553 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:33:55.167501 5722 leader_election.cc:334] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.970s (SENT)
I20260807 13:33:55.171082 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.175336 5542 raft_consensus.cc:2354] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
I20260807 13:33:55.172341 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.176594 5556 raft_consensus.cc:2379] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:55.168817 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:55.180634 5722 leader_election.cc:334] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.033s (SENT)
I20260807 13:33:55.187201 9493 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:55.187356 9423 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:55.188095 9423 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:55.169978 9543 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:55.191756 9423 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:55.170143 9534 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:33:55.211992 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.212513 5722 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:55.212966 5542 raft_consensus.cc:2354] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
W20260807 13:33:55.214874 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 147140us
I20260807 13:33:55.218376 5501 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:55.215785 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 108630us
I20260807 13:33:55.220683 5618 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:55.222456 5618 leader_election.cc:398] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6.
I20260807 13:33:55.222911 5618 leader_election.cc:401] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260807 13:33:55.224350 5618 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:55.116467 8464 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:55.125896 9549 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:55.227819 9560 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6.
I20260807 13:33:55.227185 9593 raft_consensus.cc:2741] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260807 13:33:55.228703 9410 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:55.227319 9455 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:55.230118 9376 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:55.230829 5501 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:55.230661 9376 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:55.231210 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:55.232000 5658 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 8
I20260807 13:33:55.232205 5501 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:55.232798 9376 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:55.233152 9455 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:55.233345 9376 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:55.236632 9575 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:55.240645 5555 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:55.241822 5618 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:55.236286 5501 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:55.243002 5658 raft_consensus.cc:2454] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
I20260807 13:33:55.244019 5501 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:55.181901 5554 pending_rounds.cc:76] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 2
I20260807 13:33:55.244732 5554 pending_rounds.cc:97] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260807 13:33:55.245144 6636 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:33:55.247257 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 66667.4us
W20260807 13:33:55.247486 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 281122us
I20260807 13:33:55.248301 5499 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:33:55.248970 5544 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s user 0.014s sys 0.009s
W20260807 13:33:55.249389 5544 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s user 0.014s sys 0.010s
I20260807 13:33:55.245972 5554 raft_consensus.cc:2866] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:55.251381 5618 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:33:55.242900 9493 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:55.263043 5555 raft_consensus.cc:1261] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 13:33:55.245853 9534 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:55.246034 9543 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:55.246573 9623 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:55.264528 5553 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
W20260807 13:33:55.264992 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 231777us
I20260807 13:33:55.245738 9595 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:33:55.275276 5621 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:55.277375 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:55.257035 9575 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:33:55.278626 5555 raft_consensus.cc:1261] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:55.261968 9449 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:55.282189 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:55.285473 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:55.303141 5661 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:55.293883 5665 raft_consensus.cc:1261] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:33:55.278637 5763 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:55.300442 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:55.305297 5662 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:55.265002 9593 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:55.262149 9493 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:55.302501 5658 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:55.319485 5555 raft_consensus.cc:1261] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260807 13:33:55.320236 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 134987us
I20260807 13:33:55.335003 5763 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 9.
I20260807 13:33:55.336640 6638 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:33:55.347374 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:55.348153 5665 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:55.357553 5665 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:33:55.264658 9376 consensus_queue.cc:1035] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260807 13:33:55.272111 9560 consensus_queue.cc:1035] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260807 13:33:55.300539 9346 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:55.317528 9623 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260807 13:33:55.317929 9493 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:55.271768 9591 consensus_queue.cc:1035] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260807 13:33:55.320919 9575 raft_consensus.cc:686] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:55.301096 9364 consensus_queue.cc:1035] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260807 13:33:55.371084 5555 raft_consensus.cc:1261] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 13:33:55.389429 9575 consensus_queue.cc:237] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:55.370179 5660 raft_consensus.cc:1261] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:33:55.313881 9543 consensus_queue.cc:1035] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260807 13:33:55.344494 9593 raft_consensus.cc:686] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:55.402984 9593 consensus_queue.cc:237] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:55.410429 9377 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:55.401948 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1281) took 1012 ms. Trace:
I20260807 13:33:55.415431 5548 rpcz_store.cc:276] 0807 13:33:54.389714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:54.490079 (+100365us) service_pool.cc:227] Handling call
0807 13:33:54.490437 (+ 358us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:54.511954 (+ 21517us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:54.511996 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:54.539229 (+ 27233us) log.cc:842] Serialized 26 byte log entry
0807 13:33:54.796304 (+257075us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:55.401101 (+604797us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18003eb000. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff68200582c 00007ff67f4309dc 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44b155 00007ff685d4b167 00007ff682380807 00007ff68238ff0f
0807 13:33:55.401282 (+ 181us) log.cc:842] Serialized 14 byte log entry
0807 13:33:55.401522 (+ 240us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:55.401618 (+ 96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:55.401663 (+ 45us) raft_consensus.cc:1671] finished
0807 13:33:55.401770 (+ 107us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:55.401890 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6774,"prepare.queue_time_us":105544,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":33228,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":193,"spinlock_wait_cycles":4087040,"thread_start_us":321389,"threads_started":2,"wal-append.queue_time_us":384976}
I20260807 13:33:55.380456 9346 raft_consensus.cc:686] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:33:55.421022 9346 consensus_queue.cc:237] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:55.409793 5390 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51200 (request call id 192) took 18844 ms (client timeout 15000 ms). Trace:
I20260807 13:33:55.424583 5548 raft_consensus.cc:1261] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:55.345082 9449 raft_consensus.cc:686] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:55.368324 9438 consensus_queue.cc:1046] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260807 13:33:55.376825 9351 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:33:55.457608 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:55.458340 5660 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:33:55.467939 9449 consensus_queue.cc:237] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:55.474709 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:55.475909 5545 raft_consensus.cc:2396] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260807 13:33:55.482535 5658 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 13:33:55.482749 9549 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:55.484925 9549 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:55.485455 9277 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:55.486089 6692 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:55.487042 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:55.488041 9351 raft_consensus.cc:686] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:55.488989 9351 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:55.490857 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1262) took 1151 ms. Trace:
I20260807 13:33:55.491328 5543 rpcz_store.cc:276] 0807 13:33:54.339474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:54.339601 (+ 127us) service_pool.cc:227] Handling call
0807 13:33:54.697065 (+357464us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:54.697896 (+ 831us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:55.490586 (+792690us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400335ed0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:33:55.490778 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":821332224}
I20260807 13:33:55.493552 9623 raft_consensus.cc:3032] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:55.494012 9623 raft_consensus.cc:729] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:55.495019 9623 consensus_queue.cc:260] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:55.496692 9623 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:55.422324 5390 rpcz_store.cc:269] 0807 13:33:36.565355 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:36.565777 (+ 422us) service_pool.cc:227] Handling call
0807 13:33:36.733362 (+167585us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b54002efed4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6882d0d6c 00007ff6883cac3e 00007ff6866dcfb4 00007ff6866dcf42 00007ff6866dce71 00007ff6866dcdec 00007ff6866dc0a2 00007ff6807a094c 00007ff68079fd86
0807 13:33:55.409685 (+18676323us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:52.933038 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:52.933536 (+ 498us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:52.933570 (+ 34us) write_op.cc:435] Acquired schema lock
0807 13:33:52.933586 (+ 16us) tablet.cc:660] Decoding operations
0807 13:33:52.934442 (+ 856us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:52.934521 (+ 79us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:52.934560 (+ 39us) tablet.cc:683] Acquiring locks for 7 operations
0807 13:33:52.935368 (+ 808us) tablet.cc:699] Row locks acquired
0807 13:33:52.935393 (+ 25us) write_op.cc:260] PREPARE: finished
0807 13:33:52.935573 (+ 180us) write_op.cc:270] Start()
0807 13:33:52.935717 (+ 144us) write_op.cc:276] Timestamp: P: 1786109632935521 usec, L: 0
0807 13:33:52.935744 (+ 27us) op_driver.cc:331] REPLICATION: starting
0807 13:33:52.936398 (+ 654us) log.cc:842] Serialized 2845 byte log entry
0807 13:33:53.594323 (+657925us) op_driver.cc:444] REPLICATION: finished
0807 13:33:53.633329 (+ 39006us) write_op.cc:301] APPLY: starting
0807 13:33:53.633416 (+ 87us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:53.633630 (+ 214us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:53.633759 (+ 129us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:53.637668 (+ 3909us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:53.637966 (+ 298us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0807 13:33:53.638030 (+ 64us) write_op.cc:312] APPLY: finished
0807 13:33:53.638363 (+ 333us) log.cc:842] Serialized 58 byte log entry
0807 13:33:53.638527 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:53.638636 (+ 109us) write_op.cc:454] Released schema lock
0807 13:33:53.638676 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:53.641910 (+ 3234us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:53.641955 (+ 45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":45,"spinlock_wait_cycles":228649344,"child_traces":[["op",{"apply.queue_time_us":22856,"apply.run_cpu_time_us":3178,"apply.run_wall_time_us":9053,"num_ops":7,"prepare.queue_time_us":376695,"prepare.run_cpu_time_us":15318,"prepare.run_wall_time_us":129910,"raft.queue_time_us":163378,"raft.run_cpu_time_us":5180,"raft.run_wall_time_us":46380,"replication_time_us":654408,"thread_start_us":382190,"threads_started":4,"wal-append.queue_time_us":139563,"wal-append.run_cpu_time_us":24137,"wal-append.run_wall_time_us":1577997}]]}
I20260807 13:33:55.508040 5662 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:55.531939 9493 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:55.534701 9493 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:55.536080 5665 raft_consensus.cc:1226] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
W20260807 13:33:55.536139 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 275702us
W20260807 13:33:55.546648 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 201266us
I20260807 13:33:55.548420 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:55.576048 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1283) took 1185 ms. Trace:
I20260807 13:33:55.546299 9455 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:55.576596 5544 rpcz_store.cc:276] 0807 13:33:54.390271 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:54.564922 (+174651us) service_pool.cc:227] Handling call
0807 13:33:54.565286 (+ 364us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:54.565548 (+ 262us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:54.565596 (+ 48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:54.601412 (+ 35816us) log.cc:842] Serialized 26 byte log entry
0807 13:33:55.249973 (+648561us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:55.261371 (+ 11398us) log.cc:842] Serialized 14 byte log entry
0807 13:33:55.575639 (+314268us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:55.575742 (+ 103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:55.575803 (+ 61us) raft_consensus.cc:1671] finished
0807 13:33:55.575823 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:55.575989 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":848,"prepare.queue_time_us":10886,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":44979,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6712,"thread_start_us":924455,"threads_started":2,"wal-append.queue_time_us":751909}
I20260807 13:33:55.616276 5555 raft_consensus.cc:1261] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 13:33:55.614741 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1289) took 1222 ms. Trace:
I20260807 13:33:55.618592 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1248) took 1003 ms. Trace:
I20260807 13:33:55.619159 5555 rpcz_store.cc:276] 0807 13:33:54.615664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.390152 (+774488us) service_pool.cc:227] Handling call
0807 13:33:55.390436 (+ 284us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:55.616651 (+226215us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:55.618354 (+ 1703us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540016fb54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:55.618539 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":518586624}
I20260807 13:33:55.618207 5552 rpcz_store.cc:276] 0807 13:33:54.391947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.203565 (+811618us) service_pool.cc:227] Handling call
0807 13:33:55.203957 (+ 392us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:55.213528 (+ 9571us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:55.213577 (+ 49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:55.219426 (+ 5849us) log.cc:842] Serialized 52 byte log entry
0807 13:33:55.438060 (+218634us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:55.453003 (+ 14943us) log.cc:842] Serialized 14 byte log entry
0807 13:33:55.453473 (+ 470us) log.cc:842] Serialized 14 byte log entry
0807 13:33:55.453746 (+ 273us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:55.453850 (+ 104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:55.487625 (+ 33775us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b18002e5ac0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e764 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:33:55.499395 (+ 11770us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b18002e5ac0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:33:55.614537 (+115142us) raft_consensus.cc:1671] finished
0807 13:33:55.614557 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:55.614682 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":48348,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":82,"raft.queue_time_us":9482,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":10226,"spinlock_wait_cycles":110813824,"thread_start_us":189727,"threads_started":1,"wal-append.queue_time_us":304704}
I20260807 13:33:55.613953 5394 catalog_manager.cc:5495] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 7, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:55.621366 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 1093) took 1093 ms. Trace:
I20260807 13:33:55.619529 5767 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 13:33:55.623885 9551 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:55.621438 5394 catalog_manager.cc:5495] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 7, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 7 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:55.668812 5394 catalog_manager.cc:5495] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 4 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:55.691363 5394 catalog_manager.cc:5495] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 6 to 7, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:55.693430 5394 catalog_manager.cc:5495] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:55.716348 5394 catalog_manager.cc:5495] T e7704ce89ae2457b9b1adf72a86591a4 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 5 to 6, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 6 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:55.718436 5394 catalog_manager.cc:5495] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 5 to 6, leader changed from d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 6 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:55.852308 5394 catalog_manager.cc:5495] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 5 to 6, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 6 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:55.862869 5394 catalog_manager.cc:5495] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 4 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:55.919260 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260807 13:33:56.204943 9631 log.cc:924] Time spent T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.580s user 0.000s sys 0.001s
W20260807 13:33:56.430913 9641 log.cc:924] Time spent T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.757s user 0.001s sys 0.000s
W20260807 13:33:56.464138 9623 consensus_meta.cc:287] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.967s user 0.009s sys 0.002s
I20260807 13:33:56.471938 5394 catalog_manager.cc:5495] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:33:56.482956 5394 catalog_manager.cc:5495] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 2 to 6, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 6 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:56.484444 5394 catalog_manager.cc:5495] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 1 to 7, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:56.485852 5394 catalog_manager.cc:5495] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 6 to 8, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 8 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:56.492630 5394 catalog_manager.cc:5495] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 6 to 7, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 7 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:56.494216 5394 catalog_manager.cc:5495] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 6, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 6 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:56.496038 5394 catalog_manager.cc:5495] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 4 to 5, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 5 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:56.497428 5394 catalog_manager.cc:5495] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 7 to 8, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 8 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:33:56.499110 5394 catalog_manager.cc:5495] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 6 to 7, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 7 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:56.502661 5394 catalog_manager.cc:5495] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:56.504499 5394 catalog_manager.cc:5495] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:33:56.506734 5394 catalog_manager.cc:5495] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 5 to 6, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 6 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:56.507731 5394 catalog_manager.cc:5495] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 5 to 8, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 8 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:33:56.514174 9501 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:56.514734 9501 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:56.521138 5658 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.032s user 0.015s sys 0.024s
W20260807 13:33:56.521471 5658 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s user 0.016s sys 0.025s
I20260807 13:33:56.522161 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 222) took 1034 ms. Trace:
I20260807 13:33:56.522531 5658 rpcz_store.cc:276] 0807 13:33:55.487594 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.487819 (+ 225us) service_pool.cc:227] Handling call
0807 13:33:55.488181 (+ 362us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:55.488524 (+ 343us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:55.488552 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:55.489196 (+ 644us) log.cc:842] Serialized 52 byte log entry
0807 13:33:56.521791 (+1032595us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:56.521829 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:56.521894 (+ 65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:56.521934 (+ 40us) raft_consensus.cc:1671] finished
0807 13:33:56.521945 (+ 11us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:56.522060 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6899,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":1032167,"threads_started":1,"wal-append.queue_time_us":1010904}
W20260807 13:33:56.531345 9351 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.039s user 0.010s sys 0.012s
W20260807 13:33:56.536031 9351 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.044s user 0.010s sys 0.013s
I20260807 13:33:56.542928 9501 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.546204 9501 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:56.546875 9501 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.548903 9501 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.549393 9501 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:56.549806 9501 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.551973 9501 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.564677 6692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37838 (request call id 145) took 1361 ms. Trace:
W20260807 13:33:56.654536 5437 debug-util.cc:398] Leaking SignalData structure 0x7b0800034840 after lost signal to thread 3828
I20260807 13:33:56.569821 6692 rpcz_store.cc:276] 0807 13:33:55.203197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.210338 (+ 7141us) service_pool.cc:227] Handling call
0807 13:33:55.214121 (+ 3783us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:55.486513 (+272392us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:56.564280 (+1077767us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400542754. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:33:56.564550 (+ 270us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":624956800}
W20260807 13:33:56.835630 5620 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.463s user 0.026s sys 0.024s
W20260807 13:33:56.836018 5620 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.463s user 0.026s sys 0.024s
W20260807 13:33:56.836268 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 1.49023e+06us
I20260807 13:33:56.839587 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1290) took 2447 ms. Trace:
I20260807 13:33:56.840106 5542 rpcz_store.cc:276] 0807 13:33:54.392223 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.225163 (+832940us) service_pool.cc:227] Handling call
0807 13:33:55.225565 (+ 402us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:55.226047 (+ 482us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:55.226114 (+ 67us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:55.241338 (+ 15224us) log.cc:842] Serialized 26 byte log entry
0807 13:33:55.509409 (+268071us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:55.509443 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:55.509513 (+ 70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:56.839351 (+1329838us) raft_consensus.cc:1671] finished
0807 13:33:56.839374 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:56.839524 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":7588,"thread_start_us":267804,"threads_started":1,"wal-append.queue_time_us":362096}
I20260807 13:33:56.841183 9501 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:56.845872 9501 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.846804 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:56.852988 5658 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:56.851091 5767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47820 (request call id 232) took 1224 ms. Trace:
I20260807 13:33:56.854090 5767 rpcz_store.cc:276] 0807 13:33:55.626589 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.627968 (+ 1379us) service_pool.cc:227] Handling call
0807 13:33:56.850542 (+1222574us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:56.850740 (+ 198us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:56.850767 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:56.850809 (+ 42us) raft_consensus.cc:1631] Marking committed up to 8
0807 13:33:56.850844 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:56.850895 (+ 51us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:56.851013 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:56.856717 9501 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.861709 9299 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:56.862284 9299 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.864246 9299 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:56.864711 9299 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:56.865547 9299 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:33:56.866762 5544 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.249s user 0.013s sys 0.013s
W20260807 13:33:56.873507 5544 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.256s user 0.013s sys 0.013s
I20260807 13:33:56.875543 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1277) took 2185 ms. Trace:
I20260807 13:33:56.875943 5544 rpcz_store.cc:276] 0807 13:33:54.690085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.616218 (+926133us) service_pool.cc:227] Handling call
0807 13:33:55.616574 (+ 356us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:55.616925 (+ 351us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:55.616952 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:55.617356 (+ 404us) log.cc:842] Serialized 26 byte log entry
0807 13:33:56.873917 (+1256561us) raft_consensus.cc:1631] Marking committed up to 8
0807 13:33:56.874735 (+ 818us) log.cc:842] Serialized 14 byte log entry
0807 13:33:56.874941 (+ 206us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:56.875021 (+ 80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:56.875357 (+ 336us) raft_consensus.cc:1671] finished
0807 13:33:56.875372 (+ 15us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:56.875477 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1329,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"thread_start_us":1256215,"threads_started":1,"wal-append.queue_time_us":902807}
I20260807 13:33:56.870409 9223 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:56.877597 9223 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.872443 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:56.879431 5660 raft_consensus.cc:1226] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260807 13:33:56.875577 9534 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:56.882895 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:56.882057 9223 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.884434 9223 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:56.884862 9223 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.888738 9299 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:56.889233 9299 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:56.892009 9364 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:56.892638 9364 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.894646 9364 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.895123 9364 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:56.895444 5770 raft_consensus.cc:1261] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:56.895578 9364 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.881819 9534 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.896862 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:56.897559 5770 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:56.899390 9534 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:56.899405 5771 raft_consensus.cc:1261] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:33:56.900745 9364 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.901284 9364 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:56.901813 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:56.901741 9364 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:56.902532 5761 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:56.889693 9299 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.905758 9299 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:56.906893 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:56.907444 9590 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:56.930229 9590 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.932216 9590 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.932685 9590 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:56.933140 9590 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:56.934767 5761 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:33:56.915447 5661 raft_consensus.cc:1226] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:33:56.918172 9621 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:56.918249 9623 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:56.943087 9621 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:56.943465 9623 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:56.945072 9621 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:56.945508 9623 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:56.946235 9590 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:56.920866 5499 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:56.914208 9364 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:56.922300 9650 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:56.949384 9650 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.951468 9650 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.922533 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:56.924957 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:56.925391 9348 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:56.926743 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:56.953663 5764 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:56.953560 9348 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.934875 9449 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:56.954587 9449 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.955628 9348 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.956638 9449 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:56.957352 9449 consensus_queue.cc:1046] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:33:56.957643 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:56.958650 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:56.959285 5762 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:56.959470 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:56.958937 9449 consensus_queue.cc:1046] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 13:33:56.961336 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:56.961966 5662 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:33:56.963340 9623 raft_consensus.cc:3032] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:56.963305 5499 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:56.963989 9623 raft_consensus.cc:729] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:56.965229 9621 raft_consensus.cc:3032] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:33:56.965647 9621 raft_consensus.cc:729] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:55.571698 9438 raft_consensus.cc:2781] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:56.966727 9438 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:56.966488 9621 consensus_queue.cc:260] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.967083 9438 raft_consensus.cc:3037] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:56.967667 9621 raft_consensus.cc:3037] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:56.971997 9354 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:56.972700 5545 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.476s user 0.015s sys 0.035s
I20260807 13:33:56.972500 9354 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:56.973003 5545 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.476s user 0.015s sys 0.035s
I20260807 13:33:56.977814 9207 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:56.978360 9207 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:56.989141 9455 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:56.989771 9348 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:56.990548 9348 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:56.989742 9455 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:56.996160 9455 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:56.997403 9455 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:56.997802 9455 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:57.002966 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:57.004767 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:57.005968 9299 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:57.006528 9299 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:57.010284 9623 consensus_queue.cc:260] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.011716 9623 raft_consensus.cc:3037] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:57.012194 9207 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:57.014199 9455 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:57.016356 9438 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:57.017211 5556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1286) took 2626 ms. Trace:
I20260807 13:33:56.921486 9223 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.010655 9354 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:57.022759 9687 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:57.026048 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 62846us
I20260807 13:33:57.027540 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.028116 9299 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:57.028201 5659 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:33:57.032755 9650 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:57.033870 9455 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.034718 9650 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:57.035171 9650 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:57.017699 5556 rpcz_store.cc:276] 0807 13:33:54.391121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.177746 (+786625us) service_pool.cc:227] Handling call
0807 13:33:55.178132 (+ 386us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:55.178549 (+ 417us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:55.178583 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:55.179080 (+ 497us) log.cc:842] Serialized 26 byte log entry
0807 13:33:55.363694 (+184614us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:55.363749 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:55.363854 (+ 105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:57.016955 (+1653101us) raft_consensus.cc:1671] finished
0807 13:33:57.016983 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:57.017144 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":488,"raft.queue_time_us":115,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":15040,"thread_start_us":184247,"threads_started":1,"wal-append.queue_time_us":356273}
I20260807 13:33:57.044219 9650 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.045146 9687 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:57.046761 9683 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.047685 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:57.047420 9683 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.046850 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1270) took 2358 ms. Trace:
I20260807 13:33:57.049139 5659 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:57.048424 5545 rpcz_store.cc:276] 0807 13:33:54.688532 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.476579 (+788047us) service_pool.cc:227] Handling call
0807 13:33:55.476970 (+ 391us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:55.477219 (+ 249us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:55.496486 (+ 19267us) log.cc:842] Serialized 14 byte log entry
0807 13:33:56.973563 (+1477077us) log.cc:842] Serialized 14 byte log entry
0807 13:33:57.032402 (+ 58839us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:57.032465 (+ 63us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:57.032524 (+ 59us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:57.046666 (+ 14142us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:57.046793 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18166,"prepare.queue_time_us":41460,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":100,"raft.queue_time_us":97676,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":173,"thread_start_us":1535209,"threads_started":2,"wal-append.queue_time_us":983737}
I20260807 13:33:57.051541 9682 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.051980 9682 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.052572 9621 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.053081 9621 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.054143 5499 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:57.056051 9455 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.056854 9687 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:57.057046 9455 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:33:55.621785 5555 rpcz_store.cc:276] 0807 13:33:54.527843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.620298 (+1092455us) service_pool.cc:227] Handling call
0807 13:33:55.621308 (+ 1010us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:57.057477 9455 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:57.059244 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:57.059912 5659 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:57.059937 9590 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.060612 9590 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.062659 9590 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.062849 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.064280 9438 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:57.057880 9455 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:57.065193 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.071426 9438 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.071908 9438 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.073812 9438 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.074361 9681 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:33:57.077877 9346 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.456s user 0.008s sys 0.009s
I20260807 13:33:57.078332 9698 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.083961 9621 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:57.084188 9346 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.462s user 0.009s sys 0.010s
I20260807 13:33:57.084875 5761 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:57.085115 9650 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.085428 5761 raft_consensus.cc:595] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
W20260807 13:33:57.081241 8464 consensus_meta.cc:287] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 1.838s user 0.017s sys 0.010s
I20260807 13:33:57.084522 9621 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.085829 5761 raft_consensus.cc:603] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:57.085991 8464 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:57.085673 9650 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.085747 5721 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.089556 5721 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.080247 9687 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.079166 5659 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
W20260807 13:33:57.082369 5618 leader_election.cc:334] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.717s (SENT)
I20260807 13:33:57.081591 9590 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:33:57.094417 5662 raft_consensus.cc:2396] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260807 13:33:57.081866 5620 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.082571 9681 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.091878 5618 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:33:57.086233 9621 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.095547 5499 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:33:57.096315 5721 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.100641 5620 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.105152 5721 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.106166 5721 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.106544 5620 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.107348 9534 consensus_queue.cc:1035] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 13:33:57.106686 9207 raft_consensus.cc:2781] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:33:57.108144 9207 raft_consensus.cc:686] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:57.108242 8464 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:57.108777 8464 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.096441 9354 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:57.109218 8464 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.101985 9339 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:57.109872 9354 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:57.096630 9422 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:57.110734 9354 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:57.111049 9422 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:57.111231 8464 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.111508 9422 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:57.111752 8464 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:33:57.112190 8464 raft_consensus.cc:686] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:57.113090 8464 consensus_queue.cc:237] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.107537 5620 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.129948 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.137344 5770 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:33:57.139408 5661 raft_consensus.cc:1261] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 13:33:57.115614 5620 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.141539 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.145071 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.145689 5771 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:57.087565 9650 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.157552 9318 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:33:57.100507 9299 consensus_queue.cc:1035] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260807 13:33:57.147502 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.159955 5661 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:57.151638 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.108987 9534 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:33:57.082401 9438 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.109004 9207 consensus_queue.cc:237] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.155509 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.155843 9364 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:57.100005 9346 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:57.156906 9621 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.110744 9339 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:57.157047 9348 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:57.100260 9223 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260807 13:33:57.171402 6694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:57.099038 9687 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.091346 9698 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.493837 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.502948 5656 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:33:57.503707 5661 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260807 13:33:57.177964 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.499588 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:57.496410 5553 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.179s user 0.045s sys 0.038s
W20260807 13:33:57.508327 5553 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.191s user 0.045s sys 0.038s
I20260807 13:33:57.510986 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1297) took 3116 ms. Trace:
W20260807 13:33:57.512452 5554 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.212s user 0.035s sys 0.023s
W20260807 13:33:57.512991 5554 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.213s user 0.036s sys 0.024s
W20260807 13:33:57.503768 5618 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.877s (SENT) [suppressed 34 similar messages]
W20260807 13:33:57.518537 5548 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.060s user 0.032s sys 0.028s
W20260807 13:33:57.518915 5548 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.060s user 0.032s sys 0.028s
W20260807 13:33:57.518537 5543 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.024s user 0.020s sys 0.035s
W20260807 13:33:57.527823 5543 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.034s user 0.021s sys 0.035s
I20260807 13:33:57.529258 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1271) took 2840 ms. Trace:
I20260807 13:33:57.483644 5620 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.511583 5553 rpcz_store.cc:276] 0807 13:33:54.394355 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.273724 (+879369us) service_pool.cc:227] Handling call
0807 13:33:55.274069 (+ 345us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:55.279630 (+ 5561us) raft_consensus.cc:1520] Early marking committed up to index 3
0807 13:33:55.316750 (+ 37120us) log.cc:842] Serialized 14 byte log entry
0807 13:33:57.509957 (+2193207us) log.cc:842] Serialized 14 byte log entry
0807 13:33:57.510348 (+ 391us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:57.510434 (+ 86us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:57.510531 (+ 97us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:57.510681 (+ 150us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:57.510865 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":37942,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"thread_start_us":2191633,"threads_started":1,"wal-append.queue_time_us":1158539}
W20260807 13:33:57.221247 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 75323.2us
I20260807 13:33:57.541915 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.532912 5543 rpcz_store.cc:276] 0807 13:33:54.688772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.492427 (+803655us) service_pool.cc:227] Handling call
0807 13:33:55.492839 (+ 412us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:55.493106 (+ 267us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:55.493142 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:55.493602 (+ 460us) log.cc:842] Serialized 26 byte log entry
0807 13:33:57.528607 (+2035005us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:57.528711 (+ 104us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:57.528847 (+ 136us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:57.528930 (+ 83us) raft_consensus.cc:1671] finished
0807 13:33:57.528942 (+ 12us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:57.529166 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":2034408,"threads_started":1,"wal-append.queue_time_us":1003492}
I20260807 13:33:57.322315 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:57.330139 6691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:57.566481 9339 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
W20260807 13:33:57.157997 9678 log.cc:924] Time spent T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
W20260807 13:33:57.579021 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 47486.1us
I20260807 13:33:57.109742 9681 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.155570 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:57.584822 9497 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.585421 9600 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.184691 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.214594 9644 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.587256 9619 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:57.588761 9623 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.589977 9689 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.593235 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:57.375243 9501 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s user 0.019s sys 0.066s
I20260807 13:33:57.593911 9214 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.622730 9214 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:57.624143 9600 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.596407 9543 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.626466 9689 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.626746 9543 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.628652 9281 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.597077 9346 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:57.629901 9346 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:57.629628 9281 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.633137 9281 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.614161 9339 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:57.112208 9591 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:33:57.634593 9591 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:57.635188 9591 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:57.157996 9318 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:57.638473 9318 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:57.599028 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1266) took 2911 ms. Trace:
I20260807 13:33:57.601943 9272 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.602356 9449 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:33:57.378404 9575 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.985s user 0.024s sys 0.019s
I20260807 13:33:57.646661 9600 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.647368 9600 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.648159 9600 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.648521 5503 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:33:57.612950 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 129930us
W20260807 13:33:57.399331 9593 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.947s user 0.007s sys 0.026s
I20260807 13:33:57.157059 9590 raft_consensus.cc:482] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:57.313442 9650 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.638317 5763 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:57.347355 9061 consensus_queue.cc:1035] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.253s
I20260807 13:33:57.312901 9299 raft_consensus.cc:2781] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:57.643728 9449 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.386600 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:57.639494 5548 rpcz_store.cc:276] 0807 13:33:54.687496 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.425468 (+737972us) service_pool.cc:227] Handling call
0807 13:33:55.425798 (+ 330us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:55.426239 (+ 441us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:55.426276 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:55.437465 (+ 11189us) log.cc:842] Serialized 52 byte log entry
0807 13:33:57.519642 (+2082177us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:57.520169 (+ 527us) log.cc:842] Serialized 14 byte log entry
0807 13:33:57.579579 (+ 59410us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:57.598543 (+ 18964us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:57.598652 (+ 109us) raft_consensus.cc:1671] finished
0807 13:33:57.598664 (+ 12us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:57.598956 (+ 292us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":45344,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":80408,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":10718,"thread_start_us":2119385,"threads_started":2,"wal-append.queue_time_us":1023149}
I20260807 13:33:57.658211 9272 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.333070 9422 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.660588 9619 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.661019 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:33:57.724900 5437 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb920 after lost signal to thread 5446
I20260807 13:33:57.661512 9687 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.661784 9497 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.662951 9644 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.170847 9534 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:33:57.664072 9501 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s user 0.019s sys 0.067s
I20260807 13:33:57.664255 9698 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.375932 9682 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.664713 9623 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.155465 9455 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:57.666131 9590 raft_consensus.cc:504] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:57.311455 9700 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:57.219481 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:57.672433 5721 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.629561 9689 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.629549 9543 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.642858 9214 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:57.676734 9299 raft_consensus.cc:686] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:57.678880 9650 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:33:57.681051 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.658243 9364 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:57.684235 9422 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:57.688798 9318 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.207883 9438 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.376847 9354 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.692022 9272 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:57.347185 9705 consensus_queue.cc:1046] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.345s
I20260807 13:33:57.699558 9600 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.706223 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.706996 5763 raft_consensus.cc:595] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:57.716809 9683 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:57.751609 9593 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.295s user 0.008s sys 0.035s
I20260807 13:33:57.753116 9619 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.753436 9497 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:57.754629 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 82499.1us
I20260807 13:33:57.756757 9644 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:57.757617 9708 log.cc:924] Time spent T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.110s user 0.000s sys 0.001s
I20260807 13:33:57.748760 9364 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:33:57.758272 9575 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.344s user 0.024s sys 0.028s
I20260807 13:33:57.746552 9534 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:57.758747 9705 raft_consensus.cc:3032] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:57.787247 9705 raft_consensus.cc:729] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:57.787533 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:57.788475 9705 consensus_queue.cc:260] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.792291 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.792870 9318 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.794401 9495 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:33:57.794869 9495 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:57.795315 9495 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:57.798890 9346 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.800559 9590 leader_election.cc:288] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:57.800982 9346 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.801695 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.807318 5665 raft_consensus.cc:1226] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:57.763761 9339 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.809623 9339 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.759845 9438 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.763243 5763 raft_consensus.cc:603] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:57.771075 9700 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:57.772572 9354 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:57.773398 9623 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.774612 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:57.774421 9299 consensus_queue.cc:237] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.775692 5771 raft_consensus.cc:2379] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:33:57.780503 5722 connection.cc:232] RPC call timeout handler was delayed by -2.1352810489479452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260807 13:33:57.781160 5769 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s user 0.035s sys 0.027s
I20260807 13:33:57.782267 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:57.785018 5437 debug-util.cc:398] Leaking SignalData structure 0x7b080011ce60 after lost signal to thread 5594
I20260807 13:33:57.786512 9455 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:57.793975 5765 raft_consensus.cc:1226] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
W20260807 13:33:57.814744 5437 debug-util.cc:398] Leaking SignalData structure 0x7b0800337ba0 after lost signal to thread 5596
W20260807 13:33:57.817369 5769 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s user 0.036s sys 0.028s
I20260807 13:33:57.817777 5766 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:57.818850 9061 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:33:57.819443 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 57279.4us
I20260807 13:33:57.820071 5721 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.821092 9422 consensus_queue.cc:1046] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:33:57.822052 9493 consensus_queue.cc:1035] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:33:57.822566 9348 consensus_queue.cc:1035] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:57.823985 9493 consensus_queue.cc:1035] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:33:57.789898 5499 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:57.824849 9651 consensus_queue.cc:1035] T e25f5d92529949cb904fde2d44bd715a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 13:33:57.826967 9644 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:33:57.827739 9458 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:57.828261 9458 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:57.828630 9458 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:57.793795 9591 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:57.831722 5437 debug-util.cc:398] Leaking SignalData structure 0x7b08003da780 after lost signal to thread 5702
W20260807 13:33:57.832032 5437 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8100 after lost signal to thread 5703
I20260807 13:33:57.832399 9591 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:57.833223 5437 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9980 after lost signal to thread 5805
I20260807 13:33:57.834596 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:57.836004 9536 raft_consensus.cc:3032] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:57.836447 9536 raft_consensus.cc:729] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:57.837203 9700 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:33:57.837949 5722 leader_election.cc:334] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.969s (SENT)
W20260807 13:33:57.839246 5722 connection.cc:232] RPC call timeout handler was delayed by -2.0114911610726267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260807 13:33:57.839607 5722 connection.cc:232] RPC call timeout handler was delayed by -1.9885810487903655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23210000000000003s for a response
W20260807 13:33:57.840226 5722 connection.cc:232] RPC call timeout handler was delayed by -1.8251911611296237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260807 13:33:57.840520 5722 connection.cc:232] RPC call timeout handler was delayed by -1.7945911611896008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
W20260807 13:33:57.840884 5722 connection.cc:232] RPC call timeout handler was delayed by -1.7093661811668426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3327s for a response
W20260807 13:33:57.842046 5722 connection.cc:232] RPC call timeout handler was delayed by -1.5877069730777293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260807 13:33:57.843766 5722 connection.cc:232] RPC call timeout handler was delayed by -1.5772810489870608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2778s for a response
I20260807 13:33:57.843062 9449 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.844261 9061 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:57.844900 5620 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:57.837468 9536 consensus_queue.cc:260] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.825695 9493 consensus_queue.cc:1035] T b950598d88564a8a85e1489e7f9843cb P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260807 13:33:57.852855 5722 connection.cc:232] RPC call timeout handler was delayed by -1.5578819750808179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260807 13:33:57.856302 5722 connection.cc:232] RPC call timeout handler was delayed by -1.4914668209385127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
W20260807 13:33:57.856706 5722 connection.cc:232] RPC call timeout handler was delayed by -1.4233751259744167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260807 13:33:57.859027 5771 raft_consensus.cc:1226] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:57.861632 5771 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:57.862289 5771 raft_consensus.cc:595] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:33:57.862695 5771 raft_consensus.cc:603] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:57.856123 9061 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:33:57.867383 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.868327 5762 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:33:57.869036 9497 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:57.869462 9497 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:57.869379 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:57.870285 6696 raft_consensus.cc:2379] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:33:57.871927 9497 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:57.872285 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:57.873057 5662 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:33:57.874297 5722 connection.cc:232] RPC call timeout handler was delayed by -1.3014308088459074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260807 13:33:57.875304 5722 connection.cc:232] RPC call timeout handler was delayed by -1.2870308088604361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260807 13:33:57.874297 9536 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:57.883772 9455 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.884407 9455 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.886816 9455 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:33:57.887209 5437 debug-util.cc:398] Leaking SignalData structure 0x7b080033f3e0 after lost signal to thread 6738
W20260807 13:33:57.887548 5437 debug-util.cc:398] Leaking SignalData structure 0x7b0800354680 after lost signal to thread 6739
I20260807 13:33:57.888082 9455 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.878722 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.883219 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:57.888872 9455 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.883565 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:57.889922 5666 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
W20260807 13:33:57.889631 5437 debug-util.cc:398] Leaking SignalData structure 0x7b0800009280 after lost signal to thread 9517
I20260807 13:33:57.891188 9705 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
W20260807 13:33:57.891366 5722 connection.cc:232] RPC call timeout handler was delayed by -1.2233052409719676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260807 13:33:57.891789 5722 connection.cc:232] RPC call timeout handler was delayed by -1.2073810489382595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3189s for a response
W20260807 13:33:57.892066 5722 connection.cc:232] RPC call timeout handler was delayed by -1.1542444219812751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260807 13:33:57.892325 5722 connection.cc:232] RPC call timeout handler was delayed by -1.0017984160222113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260807 13:33:57.899744 9455 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.902127 5666 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:33:57.903096 9449 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.903223 9700 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.904645 5663 raft_consensus.cc:1261] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 13:33:57.904747 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:57.904901 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:57.910295 9438 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:57.910591 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1287) took 3519 ms. Trace:
I20260807 13:33:57.911204 9455 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:57.912554 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.913641 5722 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:57.905980 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:57.914172 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.914696 5766 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
W20260807 13:33:57.920456 5437 debug-util.cc:398] Leaking SignalData structure 0x7b08002849e0 after lost signal to thread 9542
I20260807 13:33:57.934557 5766 raft_consensus.cc:595] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:57.942628 5769 raft_consensus.cc:2396] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:57.943693 9449 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.944783 5769 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260807 13:33:57.945705 9700 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.947956 9700 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.949076 5555 raft_consensus.cc:2354] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6.
I20260807 13:33:57.950081 5543 raft_consensus.cc:2354] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8.
I20260807 13:33:57.950278 9455 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.952405 9455 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.952324 5722 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:57.936615 9438 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.954279 9422 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:57.954990 9422 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:57.941884 9364 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.959621 5766 raft_consensus.cc:603] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 13:33:57.959744 5437 debug-util.cc:398] Leaking SignalData structure 0x7b080038a800 after lost signal to thread 9553
W20260807 13:33:57.960180 5437 debug-util.cc:398] Leaking SignalData structure 0x7b08002eeca0 after lost signal to thread 9556
I20260807 13:33:57.962033 5548 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:57.962146 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:57.962544 5437 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb220 after lost signal to thread 9578
I20260807 13:33:57.970633 5663 raft_consensus.cc:1261] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 13:33:57.971547 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:57.971885 6637 connection.cc:232] RPC call timeout handler was delayed by -1.4932813819032162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260807 13:33:57.972790 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.974005 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.975802 5769 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:57.946024 9449 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:57.987195 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.991288 5721 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:57.991276 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.902153 9495 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:57.997278 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:57.931974 9458 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:57.994760 5620 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:58.001425 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.002133 5542 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:57.930094 5554 rpcz_store.cc:276] 0807 13:33:54.391399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.180134 (+788735us) service_pool.cc:227] Handling call
0807 13:33:55.181680 (+ 1546us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:33:55.260033 (+ 78353us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:55.260063 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:33:55.260524 (+ 461us) log.cc:842] Serialized 52 byte log entry
0807 13:33:57.513928 (+2253404us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:33:57.642438 (+128510us) log.cc:842] Serialized 14 byte log entry
0807 13:33:57.815646 (+173208us) log.cc:842] Serialized 14 byte log entry
0807 13:33:57.815795 (+ 149us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:57.910255 (+ 94460us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:57.910299 (+ 44us) raft_consensus.cc:1671] finished
0807 13:33:57.910315 (+ 16us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:57.910542 (+ 227us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12580,"prepare.queue_time_us":40458,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":87,"raft.queue_time_us":18687,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":40481,"thread_start_us":2406929,"threads_started":3,"wal-append.queue_time_us":1388162,"wal-append.run_cpu_time_us":1874,"wal-append.run_wall_time_us":1109170}
I20260807 13:33:58.002549 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:58.002700 5620 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:33:58.003669 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 50013.7us
I20260807 13:33:58.004530 9438 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:58.004942 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:58.005812 5766 raft_consensus.cc:2396] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:58.001961 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.019697 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.020372 5722 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:58.011003 5662 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:58.021239 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:58.007176 9354 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:58.038668 5769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:33:58.039539 5769 raft_consensus.cc:595] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:58.036864 5721 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:33:58.047196 5769 raft_consensus.cc:603] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:33:58.041976 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.026484 9318 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:58.052263 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.026752 9449 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:58.053707 5545 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:58.023505 9422 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.026s
I20260807 13:33:58.069622 9207 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:58.053027 9318 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:33:58.071594 9740 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260807 13:33:58.083992 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.084892 5552 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:58.085177 5767 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:58.038684 9354 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.094581 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.095573 5554 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:33:58.048396 9299 consensus_queue.cc:1046] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260807 13:33:58.102349 9538 raft_consensus.cc:2781] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:33:58.102942 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 13:33:58.103411 9347 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:33:58.097086 9739 consensus_queue.cc:1035] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
W20260807 13:33:58.111157 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 94170.4us
I20260807 13:33:58.082930 9318 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:58.142189 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.093436 9449 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.162271 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.188143 9449 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:58.194072 9458 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:58.196995 9354 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:58.198853 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.200042 5553 raft_consensus.cc:2379] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 9: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:58.203567 5548 raft_consensus.cc:1226] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:58.204308 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.204631 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.205327 5552 raft_consensus.cc:2354] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6.
I20260807 13:33:58.205746 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.206714 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.212116 5548 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:33:58.212378 5552 raft_consensus.cc:2354] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8.
I20260807 13:33:58.209264 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.155107 9364 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:58.217784 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.216710 5542 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:33:58.177947 9495 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:58.223276 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.223830 5722 leader_election.cc:398] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
I20260807 13:33:58.228719 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.232367 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.233873 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:58.243381 9748 log.cc:924] Time spent T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260807 13:33:58.245009 5542 raft_consensus.cc:1261] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:33:58.246023 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.247203 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:33:58.248099 9749 log.cc:924] Time spent T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.092s user 0.001s sys 0.000s
I20260807 13:33:58.258859 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.259765 5555 raft_consensus.cc:2396] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260807 13:33:58.260499 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.261466 5555 raft_consensus.cc:2396] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260807 13:33:58.265295 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.279002 5554 raft_consensus.cc:2396] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:33:58.281628 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.282858 5552 raft_consensus.cc:2396] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 13:33:58.287708 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:58.288682 9750 log.cc:924] Time spent T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.129s user 0.001s sys 0.000s
I20260807 13:33:58.288930 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.290036 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.290584 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.237138 9497 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:58.291445 5543 raft_consensus.cc:2379] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:58.292254 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.292836 5543 raft_consensus.cc:2362] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 7. Re-sending same reply.
I20260807 13:33:58.292923 9497 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:33:58.293730 5667 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:58.230938 9449 consensus_queue.cc:1046] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260807 13:33:58.295054 9377 raft_consensus.cc:3032] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:33:58.295415 9377 raft_consensus.cc:729] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:33:58.296265 9377 consensus_queue.cc:260] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.297489 9377 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:58.298508 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.214385 9534 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.286267 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.301312 5555 raft_consensus.cc:2362] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 8. Re-sending same reply.
I20260807 13:33:58.301882 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:58.307639 5548 raft_consensus.cc:2396] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260807 13:33:58.304651 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:58.305377 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 331799us
W20260807 13:33:58.303226 5391 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36640 (request call id 69) took 20932 ms (client timeout 15000 ms). Trace:
I20260807 13:33:58.305809 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260807 13:33:58.308830 5391 rpcz_store.cc:269] 0807 13:33:37.370581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:37.371101 (+ 520us) service_pool.cc:227] Handling call
0807 13:33:58.302992 (+20931891us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":135078,"reported_tablets":9}
I20260807 13:33:58.311543 9560 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:58.312142 9560 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.312947 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.313609 5555 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:33:58.314428 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.318128 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.318480 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.320205 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.320744 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:33:58.323424 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 158979us
I20260807 13:33:58.328003 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.328861 5548 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:58.330083 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:33:58.333631 5765 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260807 13:33:58.347764 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.353183 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:58.314944 9347 raft_consensus.cc:686] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:58.360713 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.383064 5725 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:58.384078 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:33:58.385105 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.386510 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.387653 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.284657 9061 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.384238 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:58.352427 9560 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:58.388545 5555 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
W20260807 13:33:58.458250 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 299555us
W20260807 13:33:58.454576 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 71723.7us
I20260807 13:33:58.327447 9422 raft_consensus.cc:3032] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:33:58.432271 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.319432 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:33:58.457580 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.457996 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:58.394397 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.482524 5662 raft_consensus.cc:2379] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:58.494721 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.496080 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:58.496300 5722 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:58.359200 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:33:58.499768 5763 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:58.467471 9354 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:58.483507 9422 raft_consensus.cc:729] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:58.512040 5663 raft_consensus.cc:1226] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 13:33:58.546726 9347 consensus_queue.cc:237] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:58.550931 9763 log.cc:924] Time spent T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260807 13:33:58.553756 9534 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:58.430758 9760 consensus_queue.cc:1046] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260807 13:33:58.566890 5663 raft_consensus.cc:1226] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:58.507122 5555 raft_consensus.cc:2379] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 8: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:33:58.593344 5548 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:33:58.563002 9272 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:33:58.598642 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.598723 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:33:58.599730 5548 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:33:58.599727 5555 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:33:58.582520 9591 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:33:58.559017 9318 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.606796 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.572544 9538 raft_consensus.cc:686] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:33:58.602164 6693 raft_consensus.cc:1226] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
W20260807 13:33:58.620191 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 260812us
I20260807 13:33:58.639662 9591 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:33:58.653717 5721 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:58.655274 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:58.652724 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:33:58.645841 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 149615us
I20260807 13:33:58.647068 5667 raft_consensus.cc:1226] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:58.648672 9538 consensus_queue.cc:237] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.617271 9449 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:58.661415 9449 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.662276 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a6a8da3ec47dc859ce24a3852828d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:33:58.662792 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:58.660693 9536 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:58.655498 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:58.663362 5394 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51216 (request call id 195) took 7799 ms. Trace:
I20260807 13:33:58.674578 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.674602 9591 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:58.678583 9591 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:58.682220 9551 consensus_queue.cc:1046] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260807 13:33:58.684890 5769 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:58.654268 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.698280 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.698622 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.699085 5661 raft_consensus.cc:2379] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:33:58.699944 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.702230 5501 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:58.702768 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:58.703514 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 51949.4us
I20260807 13:33:58.704118 9377 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:58.704399 5501 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:33:58.701877 5666 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
W20260807 13:33:58.707237 9766 log.cc:924] Time spent T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20260807 13:33:58.663522 9449 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:58.626467 9422 consensus_queue.cc:260] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:58.770761 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:58.766039 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 76209.7us
I20260807 13:33:58.724923 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:58.774672 5548 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 6.
I20260807 13:33:59.093631 5555 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 9.
I20260807 13:33:59.096339 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:59.096851 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:33:58.687110 9061 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:59.104941 5544 raft_consensus.cc:1226] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:58.683455 9318 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:33:58.734143 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:59.107004 5548 raft_consensus.cc:1261] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260807 13:33:59.060143 9770 log.cc:924] Time spent T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.170s user 0.001s sys 0.000s
I20260807 13:33:59.001081 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:33:59.015614 9772 log.cc:924] Time spent T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.247s user 0.001s sys 0.000s
I20260807 13:33:58.783679 5663 raft_consensus.cc:1261] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260807 13:33:59.111814 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 405920us
I20260807 13:33:59.107812 5769 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:33:59.060791 9739 raft_consensus.cc:3032] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:33:58.815851 9700 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:33:59.117880 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 428356us
W20260807 13:33:58.900868 9207 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s user 0.026s sys 0.051s
W20260807 13:33:59.113888 5552 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s user 0.014s sys 0.034s
I20260807 13:33:59.119050 5767 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:33:59.122069 5660 raft_consensus.cc:1226] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:33:59.105142 9354 consensus_queue.cc:1046] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260807 13:33:58.838904 9762 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:59.123049 5666 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:58.765416 9299 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:58.747462 9536 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:59.707412 5552 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s user 0.021s sys 0.083s
I20260807 13:33:59.231772 5722 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:33:58.758662 9777 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:33:59.172811 5548 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
W20260807 13:33:59.346387 5554 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.507s user 0.024s sys 0.038s
W20260807 13:33:59.722599 5554 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.883s user 0.028s sys 0.053s
I20260807 13:33:59.723515 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1345) took 1484 ms. Trace:
I20260807 13:33:59.723953 5554 rpcz_store.cc:276] 0807 13:33:58.239126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.355474 (+116348us) service_pool.cc:227] Handling call
0807 13:33:58.471302 (+115828us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:58.491480 (+ 20178us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 13:33:58.514390 (+ 22910us) log.cc:842] Serialized 14 byte log entry
0807 13:33:59.723003 (+1208613us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:59.723071 (+ 68us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:59.723138 (+ 67us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:59.723315 (+ 177us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:59.723453 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8453,"prepare.queue_time_us":22737,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":157146,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":1148511,"threads_started":2,"wal-append.queue_time_us":1003759}
I20260807 13:33:59.199647 5544 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260807 13:33:59.128896 5501 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:33:59.310184 5542 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.526s user 0.019s sys 0.044s
I20260807 13:33:59.173275 5553 raft_consensus.cc:1261] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260807 13:33:59.726646 5542 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.943s user 0.034s sys 0.051s
I20260807 13:33:59.727492 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1341) took 1496 ms. Trace:
I20260807 13:33:59.571120 5556 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:33:59.713364 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:33:59.247797 5770 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s user 0.019s sys 0.050s
W20260807 13:33:59.730000 5770 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.342s user 0.023s sys 0.066s
I20260807 13:33:59.731079 5656 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
W20260807 13:33:59.287807 9534 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s user 0.017s sys 0.030s
W20260807 13:33:59.732956 9534 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.083s user 0.032s sys 0.052s
W20260807 13:33:59.546304 5545 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s user 0.029s sys 0.043s
W20260807 13:33:59.734463 5545 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.139s user 0.035s sys 0.049s
I20260807 13:33:59.735257 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1289) took 1449 ms. Trace:
I20260807 13:33:59.735698 5553 rpcz_store.cc:276] 0807 13:33:58.295238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.125159 (+829921us) service_pool.cc:227] Handling call
0807 13:33:59.159205 (+ 34046us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.726726 (+567521us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:59.735194 (+ 8468us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:59.736706 5556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1279) took 1493 ms. Trace:
I20260807 13:33:59.736750 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 147) took 1091 ms. Trace:
I20260807 13:33:59.737713 5555 rpcz_store.cc:276] 0807 13:33:58.645346 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.121244 (+475898us) service_pool.cc:227] Handling call
0807 13:33:59.121538 (+ 294us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.707316 (+585778us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:59.707349 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:59.736443 (+ 29094us) raft_consensus.cc:1631] Marking committed up to 7
0807 13:33:59.736489 (+ 46us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:59.736566 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:59.736689 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":599443}
I20260807 13:33:59.727921 5542 rpcz_store.cc:276] 0807 13:33:58.231002 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.328251 (+ 97249us) service_pool.cc:227] Handling call
0807 13:33:58.479592 (+151341us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:58.490239 (+ 10647us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:58.490268 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:58.499413 (+ 9145us) log.cc:842] Serialized 26 byte log entry
0807 13:33:58.731341 (+231928us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:33:58.782946 (+ 51605us) log.cc:842] Serialized 14 byte log entry
0807 13:33:59.727091 (+944145us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:59.727187 (+ 96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:59.727264 (+ 77us) raft_consensus.cc:1671] finished
0807 13:33:59.727284 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:59.727430 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":862,"prepare.queue_time_us":49004,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":186334,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":13999,"thread_start_us":1095930,"threads_started":2,"wal-append.queue_time_us":1109945}
I20260807 13:33:59.722067 5548 pending_rounds.cc:76] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 5
I20260807 13:33:59.738665 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 146) took 1130 ms. Trace:
W20260807 13:33:59.294165 9772 log.cc:924] Time spent T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20260807 13:33:59.746672 5658 raft_consensus.cc:1261] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260807 13:33:59.713825 9207 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.399s user 0.038s sys 0.092s
I20260807 13:33:59.745236 5544 rpcz_store.cc:276] 0807 13:33:58.607951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.127083 (+519132us) service_pool.cc:227] Handling call
0807 13:33:59.187519 (+ 60436us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.726129 (+538610us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:59.738595 (+ 12466us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:59.737491 5556 rpcz_store.cc:276] 0807 13:33:58.243165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.106141 (+862976us) service_pool.cc:227] Handling call
0807 13:33:59.117703 (+ 11562us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.729520 (+611817us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:59.736564 (+ 7044us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:59.741735 5548 pending_rounds.cc:97] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260807 13:33:59.763366 5548 raft_consensus.cc:2866] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:33:59.113605 9347 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:59.751801 5770 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47820 (request call id 243) took 1598 ms. Trace:
I20260807 13:33:59.198312 9757 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:59.590677 9761 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:59.119119 9739 raft_consensus.cc:729] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:33:59.547312 9458 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:59.772895 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:59.776840 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 145) took 1199 ms. Trace:
I20260807 13:33:59.777940 5548 rpcz_store.cc:276] 0807 13:33:58.577170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.118518 (+541348us) service_pool.cc:227] Handling call
0807 13:33:59.172405 (+ 53887us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.776576 (+604171us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:59.776786 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:33:59.774474 5554 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 8. Current term is 9. Ops: []
I20260807 13:33:59.772018 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:59.771505 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:59.734516 9377 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:33:59.765941 5770 rpcz_store.cc:276] 0807 13:33:58.153507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.153653 (+ 146us) service_pool.cc:227] Handling call
0807 13:33:58.166378 (+ 12725us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:58.355259 (+188881us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:58.355295 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:58.387518 (+ 32223us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b2c00088b18. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff680d59e11 00007ff680d69442 00007ff6823b1c11 00007ff68237658a 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772
0807 13:33:58.387983 (+ 465us) log.cc:842] Serialized 26 byte log entry
0807 13:33:59.730487 (+1342504us) raft_consensus.cc:1631] Marking committed up to 7
0807 13:33:59.730549 (+ 62us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:59.730637 (+ 88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:59.730690 (+ 53us) raft_consensus.cc:1671] finished
0807 13:33:59.730708 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:59.742289 (+ 11581us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":186652,"raft.queue_time_us":190991,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":33911,"spinlock_wait_cycles":3405696,"thread_start_us":1342028,"threads_started":1,"wal-append.queue_time_us":1172639}
I20260807 13:33:59.159538 9700 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:59.776644 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:33:59.789577 5765 raft_consensus.cc:2379] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:59.781490 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 148) took 1132 ms. Trace:
I20260807 13:33:59.790138 5554 rpcz_store.cc:276] 0807 13:33:58.648705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.746232 (+1097527us) service_pool.cc:227] Handling call
0807 13:33:59.769712 (+ 23480us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.781265 (+ 11553us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:59.781440 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:59.758276 9538 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.095s user 0.010s sys 0.007s
W20260807 13:33:59.767756 9776 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s user 0.008s sys 0.008s
I20260807 13:33:59.783437 5662 raft_consensus.cc:1261] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:33:59.747303 9299 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:59.784307 5666 raft_consensus.cc:1261] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 13:33:59.784397 6636 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.602s user 0.004s sys 0.014s
W20260807 13:33:59.801805 6636 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.162s user 0.004s sys 0.015s
I20260807 13:33:59.782858 5660 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 4. Current term is 5. Ops: []
I20260807 13:33:58.670243 5394 rpcz_store.cc:276] 0807 13:33:50.820513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:50.830168 (+ 9655us) service_pool.cc:227] Handling call
0807 13:33:58.614131 (+7783963us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:33:56.535862 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:33:56.536455 (+ 593us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:33:56.536494 (+ 39us) write_op.cc:435] Acquired schema lock
0807 13:33:56.536513 (+ 19us) tablet.cc:660] Decoding operations
0807 13:33:56.537723 (+ 1210us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:33:56.537781 (+ 58us) write_op.cc:641] Partition lock acquired for write op
0807 13:33:56.537797 (+ 16us) tablet.cc:683] Acquiring locks for 22 operations
0807 13:33:56.542097 (+ 4300us) tablet.cc:699] Row locks acquired
0807 13:33:56.542133 (+ 36us) write_op.cc:260] PREPARE: finished
0807 13:33:56.542290 (+ 157us) write_op.cc:270] Start()
0807 13:33:56.542395 (+ 105us) write_op.cc:276] Timestamp: P: 1786109636542233 usec, L: 0
0807 13:33:56.542412 (+ 17us) op_driver.cc:331] REPLICATION: starting
0807 13:33:56.543083 (+ 671us) log.cc:842] Serialized 8675 byte log entry
0807 13:33:56.557314 (+ 14231us) op_driver.cc:444] REPLICATION: finished
0807 13:33:56.826385 (+269071us) write_op.cc:301] APPLY: starting
0807 13:33:56.826480 (+ 95us) tablet.cc:1365] starting BulkCheckPresence
0807 13:33:56.834684 (+ 8204us) tablet.cc:1368] finished BulkCheckPresence
0807 13:33:56.834819 (+ 135us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:33:56.836450 (+ 1631us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:33:56.836767 (+ 317us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0807 13:33:56.836818 (+ 51us) write_op.cc:312] APPLY: finished
0807 13:33:56.837306 (+ 488us) log.cc:842] Serialized 151 byte log entry
0807 13:33:56.837501 (+ 195us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:56.837718 (+ 217us) write_op.cc:454] Released schema lock
0807 13:33:56.837783 (+ 65us) write_op.cc:341] FINISH: Updating metrics
0807 13:33:56.838081 (+ 298us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:33:56.838152 (+ 71us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":76044,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":268759,"apply.run_cpu_time_us":4525,"apply.run_wall_time_us":12451,"num_ops":22,"prepare.queue_time_us":18354,"prepare.run_cpu_time_us":9761,"prepare.run_wall_time_us":12368,"raft.queue_time_us":934,"raft.run_cpu_time_us":12008,"raft.run_wall_time_us":12486,"replication_time_us":14812,"thread_start_us":34416,"threads_started":4,"wal-append.queue_time_us":10665,"wal-append.run_cpu_time_us":3505,"wal-append.run_wall_time_us":1306472}]]}
I20260807 13:33:59.787282 9449 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 13:33:59.792646 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 677233us
I20260807 13:33:59.764784 9777 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:59.778141 9207 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:33:59.808429 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:59.810491 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1340) took 1579 ms. Trace:
I20260807 13:33:59.751039 9762 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:59.794445 9538 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s user 0.011s sys 0.007s
W20260807 13:33:59.822198 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 571493us
I20260807 13:33:59.822691 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:33:59.801110 9776 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s user 0.008s sys 0.009s
I20260807 13:33:59.812856 5543 rpcz_store.cc:276] 0807 13:33:58.230652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.293475 (+ 62823us) service_pool.cc:227] Handling call
0807 13:33:58.293827 (+ 352us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:58.294672 (+ 845us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:58.294700 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:58.301449 (+ 6749us) log.cc:842] Serialized 26 byte log entry
0807 13:33:58.480222 (+178773us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:33:58.497844 (+ 17622us) log.cc:842] Serialized 14 byte log entry
0807 13:33:58.498163 (+ 319us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:33:58.498254 (+ 91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:33:58.535753 (+ 37499us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b18003abbe0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:33:59.797945 (+1262192us) raft_consensus.cc:1671] finished
0807 13:33:59.810313 (+ 12368us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:33:59.810437 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":19503,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":221,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":5312,"spinlock_wait_cycles":5509504,"thread_start_us":178366,"threads_started":1,"wal-append.queue_time_us":349004}
I20260807 13:33:59.839053 5767 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:33:59.791961 9761 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:59.794811 9458 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:59.841706 5667 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s user 0.009s sys 0.017s
W20260807 13:33:59.871855 5667 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.687s user 0.010s sys 0.017s
I20260807 13:33:59.870450 5660 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:59.873178 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:59.843282 5767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32950 (request call id 1542) took 1173 ms. Trace:
I20260807 13:33:59.874137 5767 rpcz_store.cc:276] 0807 13:33:58.666888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.685156 (+ 18268us) service_pool.cc:227] Handling call
0807 13:33:59.839682 (+1154526us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260807 13:33:59.887701 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 47250.4us
I20260807 13:33:59.790443 9757 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:59.803777 9347 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:59.840013 9061 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:59.892912 5501 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:59.892693 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:59.840855 9538 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:59.894999 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:33:59.826354 9739 consensus_queue.cc:260] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:59.895632 5660 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:33:59.895927 5666 raft_consensus.cc:2379] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:33:59.814702 9777 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:33:59.899962 9789 log.cc:924] Time spent T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.074s user 0.000s sys 0.001s
I20260807 13:33:59.900032 9739 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:33:59.906193 9449 consensus_queue.cc:1046] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:33:59.907110 9757 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:59.909188 9458 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:59.910620 9299 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:59.914997 5501 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:33:59.917157 9761 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:59.892076 9536 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:33:59.917834 9791 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:33:59.918463 9534 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:33:59.897673 9061 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:33:59.920753 9538 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:33:59.937836 9791 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:59.937628 9299 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:33:59.977260 5767 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 6. Current term is 7. Ops: []
I20260807 13:33:59.946753 9796 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:33:59.961148 9449 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:34:00.036967 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:00.037810 5762 raft_consensus.cc:2379] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 9: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:34:00.042147 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 293489us
I20260807 13:34:00.042515 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:00.046700 5771 raft_consensus.cc:2379] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:00.054840 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:00.033303 9757 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:33:59.964577 9534 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.059935 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:00.062808 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:00.069311 5769 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:00.036018 9791 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:00.156642 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:00.158275 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.041436 9700 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:00.171084 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 111737us
W20260807 13:34:00.199542 5618 leader_election.cc:334] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.877s (SENT)
I20260807 13:34:00.208060 5663 raft_consensus.cc:2379] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:00.054299 9449 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:00.217350 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 1.03361e+06us
I20260807 13:34:00.218466 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 1306) took 1075 ms. Trace:
I20260807 13:34:00.043537 9299 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.222002 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1727) took 1052 ms. Trace:
I20260807 13:34:00.218964 5663 rpcz_store.cc:276] 0807 13:33:59.133002 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.172059 (+ 39057us) service_pool.cc:227] Handling call
0807 13:34:00.156393 (+984334us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416b7c 00007ff67f41673b 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:34:00.208615 (+ 52222us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2716416}
I20260807 13:34:00.226367 5659 rpcz_store.cc:276] 0807 13:33:59.159523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.159724 (+ 201us) service_pool.cc:227] Handling call
0807 13:34:00.158071 (+998347us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:34:00.212077 (+ 54006us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12139776}
W20260807 13:34:00.217219 9785 log.cc:924] Time spent T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.152s user 0.000s sys 0.001s
W20260807 13:34:00.233528 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 173718us
W20260807 13:34:00.241199 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 326310us
I20260807 13:34:00.236115 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1342) took 1999 ms. Trace:
I20260807 13:34:00.220377 9207 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:00.045574 9796 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:00.260818 5722 leader_election.cc:398] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
I20260807 13:34:00.282374 5722 leader_election.cc:401] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:34:00.242985 5552 rpcz_store.cc:276] 0807 13:33:58.238086 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.343861 (+105775us) service_pool.cc:227] Handling call
0807 13:33:58.374572 (+ 30711us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:58.479184 (+104612us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:58.479212 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:58.514144 (+ 34932us) log.cc:842] Serialized 26 byte log entry
0807 13:33:59.708130 (+1193986us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:34:00.042729 (+334599us) log.cc:842] Serialized 14 byte log entry
0807 13:34:00.235717 (+192988us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:00.235814 (+ 97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:00.235870 (+ 56us) raft_consensus.cc:1671] finished
0807 13:34:00.235886 (+ 16us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:00.236039 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":513129,"raft.queue_time_us":210800,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":20502,"thread_start_us":1569017,"threads_started":3,"wal-append.queue_time_us":1255655}
I20260807 13:34:00.163569 9757 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:00.286051 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 86557.6us
I20260807 13:34:00.239589 9700 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:34:00.244238 9377 consensus_queue.cc:1046] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260807 13:34:00.239589 9536 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:00.298525 9536 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.300566 9536 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.284626 9347 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.303363 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:54374 (request call id 1117) took 2094 ms. Trace:
I20260807 13:34:00.303849 5553 rpcz_store.cc:276] 0807 13:33:58.208791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.747043 (+1538252us) service_pool.cc:227] Handling call
0807 13:34:00.302443 (+555400us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b54003976d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fbaf0 00007ff68237ef2a 00007ff6872bbc6e 00007ff6809b2807 00007ff6809b2792 00007ff6809b26c1 00007ff6809b263c 00007ff6809b18f2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:00.303261 (+ 818us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18242944}
W20260807 13:34:00.293924 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 271793us
I20260807 13:34:00.292845 9207 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.217130 9449 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:00.279181 9790 log.cc:924] Time spent T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.388s user 0.001s sys 0.000s
W20260807 13:34:00.312640 5618 leader_election.cc:334] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.141s (SENT)
W20260807 13:34:00.318441 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 76449.7us
I20260807 13:34:00.322404 5618 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:34:00.310375 9794 log.cc:924] Time spent T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.385s user 0.001s sys 0.001s
I20260807 13:34:00.289134 9802 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:00.291211 9777 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.325867 5766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1535) took 1670 ms. Trace:
I20260807 13:34:00.327425 5769 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:00.306630 9761 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:00.330422 5766 rpcz_store.cc:276] 0807 13:33:58.654977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.655212 (+ 235us) service_pool.cc:227] Handling call
0807 13:33:58.662452 (+ 7240us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.772694 (+1110242us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:59.772725 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:33:59.772766 (+ 41us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:33:59.772796 (+ 30us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:00.325638 (+552842us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400287654. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:00.325681 (+ 43us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:00.325811 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2504470784}
I20260807 13:34:00.336251 5501 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:34:00.338629 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 100919us
W20260807 13:34:00.341302 5656 consensus_meta.cc:287] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.602s user 0.007s sys 0.000s
I20260807 13:34:00.341610 5656 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:00.342281 5658 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:00.342022 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 1302) took 1514 ms. Trace:
I20260807 13:34:00.350505 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:00.350185 5656 rpcz_store.cc:276] 0807 13:33:58.827639 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.827844 (+ 205us) service_pool.cc:227] Handling call
0807 13:33:59.161364 (+333520us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872b81b0 00007ff6872b7a94 00007ff68099fc04 00007ff68099fb92
0807 13:34:00.341979 (+1180615us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":31032192}
W20260807 13:34:00.351380 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 126905us
W20260807 13:34:00.357788 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 122187us
I20260807 13:34:00.332737 9815 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6.
I20260807 13:34:00.367275 5499 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:00.346885 9700 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 13:34:00.373152 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 45468.3us
I20260807 13:34:00.338146 9377 consensus_queue.cc:1046] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260807 13:34:00.356434 9538 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:00.342581 9761 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.331061 9818 consensus_queue.cc:1046] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260807 13:34:00.387429 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1346) took 2148 ms. Trace:
I20260807 13:34:00.331820 9802 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.399094 5501 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:00.400130 5620 leader_election.cc:302] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:00.358418 9536 consensus_queue.cc:1035] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260807 13:34:00.388025 5545 rpcz_store.cc:276] 0807 13:33:58.239448 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.408100 (+168652us) service_pool.cc:227] Handling call
0807 13:33:58.437209 (+ 29109us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:33:58.497570 (+ 60361us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:33:58.497612 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:33:58.557999 (+ 60387us) log.cc:842] Serialized 26 byte log entry
0807 13:33:58.635142 (+ 77143us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b4800262758. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff68721d7f1 00007ff6872148e7 00007ff68721477a 00007ff68730895f 00007ff687308627 00007ff68731cb2c 00007ff68731cad8 00007ff68731ca58 00007ff68731ca13 00007ff68731bcbc 00007ff68629dbe6
0807 13:33:59.734809 (+1099667us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:34:00.178692 (+443883us) log.cc:842] Serialized 14 byte log entry
0807 13:34:00.278937 (+100245us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:00.279347 (+ 410us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:00.382345 (+102998us) raft_consensus.cc:1671] finished
0807 13:34:00.387200 (+ 4855us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:00.387362 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":51034,"prepare.queue_time_us":548941,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":17022,"raft.queue_time_us":82381,"raft.run_cpu_time_us":1368,"raft.run_wall_time_us":142957,"spinlock_wait_cycles":8513408,"thread_start_us":1629343,"threads_started":3,"wal-append.queue_time_us":1264328}
W20260807 13:34:00.403437 9814 log.cc:924] Time spent T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.074s user 0.001s sys 0.000s
W20260807 13:34:00.407593 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 45148.7us
I20260807 13:34:00.376430 9826 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 13:34:00.382579 9534 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.415877 9377 consensus_queue.cc:1046] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:34:00.416335 9819 raft_consensus.cc:2726] T dc4a6a8da3ec47dc859ce24a3852828d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 13:34:00.418229 6637 leader_election.cc:334] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.732s (SENT)
I20260807 13:34:00.420895 9813 consensus_queue.cc:1035] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:34:00.422358 9812 consensus_queue.cc:1035] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 13:34:00.401024 9829 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 13:34:00.467489 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 105034us
I20260807 13:34:00.467643 9853 raft_consensus.cc:3032] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:00.468333 9853 raft_consensus.cc:729] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:00.469463 9853 consensus_queue.cc:260] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.471300 9853 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:00.474639 9818 raft_consensus.cc:3032] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:00.475189 9818 raft_consensus.cc:729] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:34:00.479779 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 131192us
W20260807 13:34:00.482407 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 82353.6us
W20260807 13:34:00.483209 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 65004.2us
I20260807 13:34:00.419742 9299 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.465209 9826 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260807 13:34:00.484454 9790 log.cc:924] Time spent T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
W20260807 13:34:00.484612 9794 log.cc:924] Time spent T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260807 13:34:00.466357 9757 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.538465 9796 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:00.543771 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:00.544843 9761 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:34:00.545140 9823 log.cc:924] Time spent T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.177s user 0.000s sys 0.000s
I20260807 13:34:00.507750 9762 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.550796 9802 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.509850 9207 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.514837 9449 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:00.540762 9843 consensus_queue.cc:1035] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
I20260807 13:34:00.504505 9821 consensus_queue.cc:1046] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.215s
I20260807 13:34:00.564153 9821 raft_consensus.cc:3032] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:00.564589 9821 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:00.573213 9792 raft_consensus.cc:3032] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:34:00.583119 5665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1308) took 1288 ms. Trace:
I20260807 13:34:00.583608 5665 rpcz_store.cc:276] 0807 13:33:59.294715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.762867 (+468152us) service_pool.cc:227] Handling call
0807 13:33:59.763245 (+ 378us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.763489 (+ 244us) raft_consensus.cc:1520] Early marking committed up to index 6
0807 13:33:59.926491 (+163002us) log.cc:842] Serialized 14 byte log entry
0807 13:34:00.581428 (+654937us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b1800366220. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff68200582c 00007ff67f4309dc 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44b155 00007ff68236e3d0 00007ff682380576 00007ff6823910d7
0807 13:34:00.581858 (+ 430us) log.cc:842] Serialized 14 byte log entry
0807 13:34:00.582231 (+ 373us) log.cc:842] Serialized 14 byte log entry
0807 13:34:00.582510 (+ 279us) log.cc:842] Serialized 14 byte log entry
0807 13:34:00.582646 (+ 136us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:00.582688 (+ 42us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:34:00.582745 (+ 57us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:00.582923 (+ 178us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:00.583055 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15423,"prepare.queue_time_us":293334,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":103,"raft.queue_time_us":233280,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":14774,"spinlock_wait_cycles":7661952,"thread_start_us":561738,"threads_started":3,"wal-append.queue_time_us":372105}
I20260807 13:34:00.557286 9791 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:00.588342 9791 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:00.593302 9422 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:00.596755 9061 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.600235 9791 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:00.600872 9791 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.573767 9792 raft_consensus.cc:729] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:00.565649 9821 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.539435 9836 consensus_queue.cc:1035] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.098s
W20260807 13:34:00.615824 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 90431.2us
I20260807 13:34:00.618366 9700 raft_consensus.cc:3032] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:00.629825 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
W20260807 13:34:00.637763 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 257920us
I20260807 13:34:00.635903 5620 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:00.649358 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1729) took 1348 ms. Trace:
I20260807 13:34:00.649865 5658 rpcz_store.cc:276] 0807 13:33:59.300951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.769284 (+468333us) service_pool.cc:227] Handling call
0807 13:34:00.342024 (+572740us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:00.342838 (+ 814us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:00.649125 (+306287us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54002ba2d0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:00.649289 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1277562112}
I20260807 13:34:00.653066 5620 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:00.603340 9791 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:00.667330 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 354688us
W20260807 13:34:00.668159 5618 leader_election.cc:334] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.145s (SENT)
I20260807 13:34:00.668618 5618 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:00.669710 9826 consensus_queue.cc:1035] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 13:34:00.635442 9700 raft_consensus.cc:729] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:00.662679 9821 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:00.665127 9449 consensus_queue.cc:1046] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260807 13:34:00.672134 9318 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:00.689836 9377 consensus_queue.cc:1046] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260807 13:34:00.659305 9851 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:00.631008 9792 consensus_queue.cc:260] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:00.719726 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 320685us
W20260807 13:34:00.720882 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 254909us
I20260807 13:34:00.706274 9825 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:34:00.649629 9818 consensus_queue.cc:260] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:00.722184 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 54069.5us
I20260807 13:34:00.725979 5501 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:00.715893 9787 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:00.716830 9851 raft_consensus.cc:686] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:00.718567 9819 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:00.744370 9819 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.746398 9819 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:00.741935 9854 log.cc:924] Time spent T 3a1250a61f1842c192fd95f3a267926f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260807 13:34:00.743384 9851 consensus_queue.cc:237] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.724910 9826 raft_consensus.cc:3032] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:34:00.740830 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1299) took 2022 ms. Trace:
I20260807 13:34:00.727054 9449 raft_consensus.cc:3032] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:00.721684 9318 raft_consensus.cc:686] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:34:00.755404 5722 leader_election.cc:334] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.659s (SENT)
W20260807 13:34:00.767275 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 105465us
I20260807 13:34:00.751446 9848 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:00.770272 5722 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:00.769577 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1304) took 1793 ms. Trace:
W20260807 13:34:00.767373 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 62016.3us
W20260807 13:34:00.776926 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 56353.3us
I20260807 13:34:00.758993 9826 raft_consensus.cc:729] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:00.766975 9818 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:00.787081 5501 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:00.760114 5661 rpcz_store.cc:276] 0807 13:33:58.714055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:58.714467 (+ 412us) service_pool.cc:227] Handling call
0807 13:33:59.733243 (+1018776us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800043598. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f416851 00007ff67f416702 00007ff688306b09 00007ff687242730 00007ff68730879b 00007ff687308821 00007ff6872cc2b0 00007ff6872b77f9 00007ff6872b72a2 00007ff68099d684
0807 13:33:59.733457 (+ 214us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.733704 (+ 247us) raft_consensus.cc:1520] Early marking committed up to index 4
0807 13:34:00.058609 (+324905us) log.cc:842] Serialized 14 byte log entry
0807 13:34:00.538252 (+479643us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b1800320260. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff681ff75bb 00007ff681ffd063 00007ff681ffd57b 00007ff68238088a
0807 13:34:00.735676 (+197424us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:00.735750 (+ 74us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:34:00.735809 (+ 59us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:00.735869 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:00.735988 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2017,"prepare.queue_time_us":301697,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":2134,"spinlock_wait_cycles":153114368,"thread_start_us":498756,"threads_started":2}
I20260807 13:34:00.791186 5620 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:00.729020 9700 consensus_queue.cc:260] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.803288 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:00.777027 9739 consensus_meta.cc:287] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c: Time spent flushing consensus metadata: real 0.850s user 0.013s sys 0.000s
I20260807 13:34:00.796058 9826 consensus_queue.cc:260] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.809337 9826 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:00.796833 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:00.810236 6637 leader_election.cc:334] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.124s (SENT)
I20260807 13:34:00.810631 9700 raft_consensus.cc:3037] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:34:00.809434 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 69901.3us
I20260807 13:34:00.739249 9787 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:00.816519 9787 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.818454 9318 consensus_queue.cc:237] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.798125 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.766139 9449 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:00.802342 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.794188 9836 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:00.787738 9792 raft_consensus.cc:3037] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:00.822942 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:00.823971 5722 leader_election.cc:334] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.675s (SENT)
I20260807 13:34:00.807771 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.811563 9846 raft_consensus.cc:2726] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:00.797394 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.812358 9347 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:00.825881 9347 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:00.806365 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.822516 9449 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.830634 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:00.831076 9449 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:00.831337 6693 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:00.807003 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.832548 5725 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:34:00.834126 5722 leader_election.cc:334] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.685s (SENT)
I20260807 13:34:00.812968 5620 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:00.835075 5722 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:00.774531 5667 rpcz_store.cc:276] 0807 13:33:58.976797 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:59.109748 (+132951us) service_pool.cc:227] Handling call
0807 13:33:59.125380 (+ 15632us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:33:59.125591 (+ 211us) raft_consensus.cc:1520] Early marking committed up to index 5
0807 13:33:59.872199 (+746608us) log.cc:842] Serialized 14 byte log entry
0807 13:34:00.278745 (+406546us) log.cc:842] Serialized 14 byte log entry
0807 13:34:00.579909 (+301164us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b18001e8c20. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44b155 00007ff68236e3d0 00007ff682380576 00007ff6823910d7 00007ff682391058
0807 13:34:00.769249 (+189340us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:00.769295 (+ 46us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:34:00.769342 (+ 47us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:00.769402 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:00.769510 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13400,"prepare.queue_time_us":821099,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":97,"raft.queue_time_us":304977,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":15287,"spinlock_wait_cycles":3613952,"thread_start_us":1282562,"threads_started":4,"wal-append.queue_time_us":421227}
I20260807 13:34:00.836529 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:00.837278 6637 leader_election.cc:334] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.149s (SENT)
I20260807 13:34:00.837721 6637 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:34:00.844589 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 57571.8us
I20260807 13:34:00.845232 5501 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:00.829974 9347 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:00.850212 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:00.854035 6637 leader_election.cc:334] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.152s (SENT)
I20260807 13:34:00.848668 9792 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:00.839046 9848 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:00.856024 9848 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:00.856460 9848 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:00.838913 9836 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:00.857227 9836 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:00.857554 9836 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:00.848534 9787 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:34:00.850807 5666 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
W20260807 13:34:00.855844 5722 leader_election.cc:334] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.822s (SENT)
I20260807 13:34:00.863782 9848 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:00.865103 5722 leader_election.cc:334] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.068s (SENT)
I20260807 13:34:00.866958 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.867101 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.868294 5667 raft_consensus.cc:2379] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 8: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:00.866618 5722 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:00.869560 9848 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:00.869683 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.871011 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.838970 9829 raft_consensus.cc:2781] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:00.875238 5501 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:00.842127 9422 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:00.881979 9777 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:00.888733 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.890277 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.876500 9347 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:00.893905 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.918411 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.918874 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.881639 9848 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:00.893601 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.894219 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.890467 5388 catalog_manager.cc:5495] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 4 to 6, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 6 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:34:00.894500 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.921262 5656 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:00.898025 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:00.901736 5722 leader_election.cc:334] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 2.101s (SENT)
I20260807 13:34:00.925933 9061 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:00.926504 9422 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:00.926466 9061 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.899458 9347 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:00.927249 9422 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.928825 9061 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.929062 9422 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.929350 9061 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:00.930181 9347 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:34:00.930578 5722 connection.cc:232] RPC call timeout handler was delayed by -1.1256371580529958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260807 13:34:00.930949 5722 connection.cc:232] RPC call timeout handler was delayed by -1.1022371579892933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260807 13:34:00.931278 5722 connection.cc:232] RPC call timeout handler was delayed by -1.0455371581483632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20260807 13:34:00.931159 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:00.911404 5661 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:00.912128 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:00.911715 9836 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:00.937213 9836 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:00.912420 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.938366 5662 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:34:00.937974 5388 catalog_manager.cc:5495] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 7 to 8, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 8 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:34:00.940361 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:00.941013 6693 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:00.942622 5501 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:00.943434 9848 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:00.944613 5501 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:00.946053 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.913173 5499 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:00.949366 9848 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:00.952497 5499 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:00.905301 9829 raft_consensus.cc:686] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:00.953723 9826 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:00.954115 9826 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:00.954439 9826 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:00.955449 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:00.955765 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:00.956143 5666 raft_consensus.cc:2379] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:00.956306 5658 raft_consensus.cc:2362] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 9. Re-sending same reply.
I20260807 13:34:00.920672 5667 raft_consensus.cc:2379] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 8: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:00.953043 9848 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:00.961412 5499 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:00.929850 9061 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.954396 9829 consensus_queue.cc:237] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.970294 9449 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:00.984007 9449 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:00.984426 9449 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:00.972250 9061 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:00.979786 6693 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:00.894582 9700 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260807 13:34:00.990792 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.991079 9700 raft_consensus.cc:3032] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:00.991147 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.991631 9700 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:00.991811 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.992424 5665 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:00.992486 9700 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.993652 9700 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:00.995368 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:00.981640 9826 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:00.941434 5388 catalog_manager.cc:5495] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:34:01.001986 5725 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:01.002961 9061 raft_consensus.cc:2781] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:01.003687 9061 raft_consensus.cc:686] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:01.009573 9826 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.009358 9449 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.014063 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:01.014681 5667 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
W20260807 13:34:01.017969 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 56168.7us
I20260807 13:34:01.025070 5721 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:01.028014 9815 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:01.029373 9815 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:01.029711 9815 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:01.017259 9863 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:01.033046 9863 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.035099 9863 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.037041 9449 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.039700 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.041109 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:01.042811 5667 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:01.004568 9061 consensus_queue.cc:237] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:01.047492 5499 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:01.051651 9449 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:01.058010 5721 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:01.063004 9422 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:01.063551 9422 raft_consensus.cc:686] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:01.069732 5721 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:01.075668 9826 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:01.075891 9818 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:01.079690 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.077531 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.080969 5553 raft_consensus.cc:2396] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260807 13:34:01.079684 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.081929 5554 raft_consensus.cc:2396] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260807 13:34:01.067668 9449 raft_consensus.cc:686] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:01.082530 5721 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:01.084323 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.084919 5543 raft_consensus.cc:2454] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:01.068840 9422 consensus_queue.cc:237] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.089617 9347 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:01.090044 9347 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:01.076378 9826 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.090395 9347 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:01.091905 9826 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.092664 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.093251 5543 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:01.093822 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.096060 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.095973 9449 consensus_queue.cc:237] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.079428 9818 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.087074 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.097833 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.098308 9818 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.098410 5544 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:01.099954 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.101456 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.101953 9807 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:34:01.102046 5761 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:01.103070 9820 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:01.103364 9807 consensus_queue.cc:1046] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 13:34:01.104449 9830 raft_consensus.cc:3032] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:01.078617 9700 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:01.104830 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:01.105314 9700 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.104846 9830 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:34:01.107380 9700 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.087862 9843 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:01.107234 9830 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:01.109117 9830 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:01.109982 9836 consensus_queue.cc:1035] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:01.111889 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:01.113976 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:01.127661 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.129570 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.131003 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.132158 5761 raft_consensus.cc:2396] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260807 13:34:01.146552 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.147567 5552 raft_consensus.cc:2379] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 9: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:01.152349 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.153204 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:01.139348 9874 log.cc:924] Time spent T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260807 13:34:01.154582 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.157477 5544 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
W20260807 13:34:01.162376 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 73601.8us
I20260807 13:34:01.162420 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.166618 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.127874 5388 catalog_manager.cc:5495] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 13:34:01.173026 5618 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:01.171617 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.174057 5544 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:01.177095 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.181552 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:01.185297 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 89994.5us
I20260807 13:34:01.178455 9829 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:34:01.193625 5765 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:01.195544 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.171000 9846 consensus_queue.cc:1046] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260807 13:34:01.201037 9846 raft_consensus.cc:3032] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:01.201376 9846 raft_consensus.cc:729] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:01.202164 9846 consensus_queue.cc:260] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:01.203439 9846 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:01.204988 9815 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.206059 5765 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:34:01.207230 9815 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:01.207381 9318 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:01.201941 5388 catalog_manager.cc:5495] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 3 to 4, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 4 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:34:01.198266 9819 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260807 13:34:01.214507 5618 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:01.199018 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:34:01.217005 9876 log.cc:924] Time spent T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.144s user 0.001s sys 0.000s
I20260807 13:34:01.218518 9819 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:01.219666 5618 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:01.226011 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.224751 5545 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:01.221817 9377 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:01.232928 9377 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:01.235054 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.235649 5548 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:01.229964 9851 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:01.245425 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.238663 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:01.248210 5554 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:01.235986 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:01.235857 9377 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:01.240113 5544 raft_consensus.cc:2454] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:01.250950 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.251729 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.252334 5543 raft_consensus.cc:2379] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:01.255400 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.257225 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.257802 5543 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:01.257882 5761 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260807 13:34:01.259460 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:01.261462 9377 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:01.263094 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.264600 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.266498 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.266573 5552 raft_consensus.cc:2396] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260807 13:34:01.265625 5544 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:01.268627 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.269348 5545 raft_consensus.cc:2396] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 13:34:01.270663 5761 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:01.272177 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.277037 5388 catalog_manager.cc:5495] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 5 to 6, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 6 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:34:01.278823 5388 catalog_manager.cc:5495] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf reported cstate change: term changed from 5 to 7, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 7 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:34:01.281551 9776 consensus_queue.cc:1035] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 13:34:01.283216 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 92837.9us
I20260807 13:34:01.288079 5548 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:01.290781 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.292280 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.293715 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.294261 9318 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:01.294766 9318 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.296701 9318 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.289077 5543 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:01.294051 9827 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:01.298995 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.299386 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.300109 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.301163 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:01.301349 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.304289 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:01.304939 5762 raft_consensus.cc:3037] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 9
I20260807 13:34:01.305382 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.306298 5543 raft_consensus.cc:2396] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260807 13:34:01.306548 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.309535 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.304363 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:01.310129 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.310268 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.310949 5544 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:01.318699 5544 raft_consensus.cc:1261] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 13:34:01.314604 5553 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:01.323432 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.324115 5543 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.326318 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.258641 9347 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.342844 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.343459 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.344008 5548 raft_consensus.cc:2396] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260807 13:34:01.346484 5544 raft_consensus.cc:2379] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:01.348050 5544 raft_consensus.cc:1261] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260807 13:34:01.320917 9739 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:01.352861 5543 raft_consensus.cc:1261] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:34:01.348349 5544 pending_rounds.cc:76] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 3
I20260807 13:34:01.353683 5544 pending_rounds.cc:97] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260807 13:34:01.353943 5544 raft_consensus.cc:2866] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:01.356083 5769 raft_consensus.cc:2354] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:01.356451 9347 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:01.342932 9848 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:01.357277 9848 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.359539 9848 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.342859 5762 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:01.367010 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.371959 5543 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:34:01.373128 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.373934 5543 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:34:01.381732 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.382339 5548 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:34:01.386778 5761 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:01.395740 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.396534 5548 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:01.365686 9739 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:01.423043 9739 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.427659 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.428525 5764 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 7.
I20260807 13:34:01.431147 6638 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:01.433393 9830 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:01.436884 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.437500 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.437727 5548 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:01.438189 5553 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:01.437814 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.438599 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.439146 5543 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.439368 5544 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.433915 9830 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:01.440507 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.440791 9830 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:01.441205 5552 raft_consensus.cc:2454] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 2.
I20260807 13:34:01.451989 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.452420 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.452648 5553 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:01.453037 5548 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:01.453572 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.454272 5554 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:01.454340 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.453513 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.455302 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:01.455307 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 113775us
I20260807 13:34:01.456405 5555 raft_consensus.cc:2379] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 8: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:01.455276 5552 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:01.459807 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.460700 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.461511 5555 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
W20260807 13:34:01.460211 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 110240us
I20260807 13:34:01.465286 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.465931 5552 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.451397 9830 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:01.471453 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.472086 5544 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:01.476969 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:01.477710 5660 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 7.
I20260807 13:34:01.481405 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.490705 5552 raft_consensus.cc:2396] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260807 13:34:01.491137 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.493291 5544 raft_consensus.cc:2396] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260807 13:34:01.496683 5552 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:01.497771 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.498189 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.498473 5552 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.498870 5543 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.498584 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.499305 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.499960 5555 raft_consensus.cc:3037] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:01.501362 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.501948 5543 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:01.502025 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.502709 5554 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:01.507189 5555 raft_consensus.cc:2454] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.507879 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.516775 5544 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.547456 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:01.548313 5761 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:34:01.548868 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 54713.3us
I20260807 13:34:01.548005 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:01.550837 5660 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:01.560530 9830 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:01.570425 9354 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:01.571209 9354 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.574745 9354 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:01.583956 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.584618 5544 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:01.590021 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.590646 5544 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:34:01.594384 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.595103 5544 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:01.597417 5761 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
I20260807 13:34:01.598939 6638 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:01.603389 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:01.612136 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:01.611423 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.616487 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.617283 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.617300 5660 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
I20260807 13:34:01.618075 5544 raft_consensus.cc:2379] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:01.615906 5556 raft_consensus.cc:2362] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 7. Re-sending same reply.
I20260807 13:34:01.623934 5542 raft_consensus.cc:2379] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 8: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:01.633754 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:01.634457 5658 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:01.601890 9830 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:01.642728 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.643349 5555 raft_consensus.cc:3037] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:34:01.647363 5618 leader_election.cc:334] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.602s (SENT)
I20260807 13:34:01.650377 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.652781 5542 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:01.655447 5618 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:01.653890 5555 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.657307 5659 raft_consensus.cc:1261] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260807 13:34:01.662743 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:01.669059 5658 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:01.679957 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.680895 5555 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:01.651844 9830 raft_consensus.cc:686] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:34:01.689872 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:01.685215 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 47273.2us
I20260807 13:34:01.796664 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.797461 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.797537 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:01.799144 5555 raft_consensus.cc:2354] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 6. Current term is 7.
I20260807 13:34:01.800469 5721 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:01.798354 5544 raft_consensus.cc:2362] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 9. Re-sending same reply.
W20260807 13:34:01.804401 5618 leader_election.cc:334] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.813s (SENT)
W20260807 13:34:01.809636 5618 leader_election.cc:334] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.946s (SENT)
I20260807 13:34:01.686419 9904 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:01.814551 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:01.818495 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.819017 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.816085 5555 raft_consensus.cc:1226] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:01.821818 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:01.822363 5618 leader_election.cc:334] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.962s (SENT)
I20260807 13:34:01.808349 9777 raft_consensus.cc:2781] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:01.827868 5762 raft_consensus.cc:1261] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:34:01.835325 5722 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:01.837661 5722 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:01.844626 5501 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:01.863736 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:01.842238 6693 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 13:34:01.848237 9299 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:01.870731 5722 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:01.840713 9777 raft_consensus.cc:686] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:01.870146 9830 consensus_queue.cc:237] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:01.884091 9777 consensus_queue.cc:237] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:01.887756 9848 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:01.851336 9354 consensus_queue.cc:1035] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.042s
I20260807 13:34:01.893862 9354 consensus_queue.cc:1225] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 [LEADER]: Peer 14f62bf285c448b9b7a21fabd7a5f0bf log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:34:01.895603 9836 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:34:01.896092 9836 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:01.896174 5722 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:01.896586 9836 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:34:01.897392 5722 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:01.898516 9299 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:01.898947 9299 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:01.904690 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:34:01.882308 9843 consensus_queue.cc:1035] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260807 13:34:01.907938 9377 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:01.908388 9843 consensus_queue.cc:1035] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:34:01.909322 9061 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:34:01.911185 9908 log.cc:924] Time spent T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.119s user 0.000s sys 0.001s
I20260807 13:34:01.864107 9815 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:34:01.914867 9896 consensus_queue.cc:1035] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:01.925958 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:01.926644 5722 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:01.926867 5543 raft_consensus.cc:2379] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:01.927793 5722 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:01.909814 9061 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:01.909902 9843 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:34:01.928963 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 101222us
W20260807 13:34:01.930368 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 107140us
W20260807 13:34:01.947269 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 102740us
I20260807 13:34:01.954895 5501 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:01.957456 5501 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:01.958731 5501 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:01.959774 5501 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:01.944031 9354 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:01.928962 5722 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:01.966697 5722 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:01.961179 5501 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:01.961047 5658 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260807 13:34:01.941390 9061 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:01.965341 9354 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:01.942153 9776 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:01.959143 9843 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:01.978614 5501 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:01.991457 5501 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:01.974545 9354 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:01.972879 9776 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:34:02.017091 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 59248.4us
I20260807 13:34:02.027972 5618 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:01.978256 9843 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:01.970805 9917 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:01.980984 9920 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:01.975754 9924 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:34:02.043103 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 60398.5us
I20260807 13:34:02.047807 9422 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:02.048254 9422 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.048638 9422 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.016532 9347 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:02.031291 9848 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:02.032703 9776 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:02.036485 9925 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:34:02.040546 9920 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.075651 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:02.082695 5618 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:02.083879 9846 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:02.085774 9318 raft_consensus.cc:2781] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:34:02.086336 9318 raft_consensus.cc:686] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.087306 9318 consensus_queue.cc:237] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.067498 9377 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:02.090399 9848 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.092121 9299 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.094172 9299 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.111032 9931 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 13:34:02.113662 9920 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.116292 5618 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:02.060372 9347 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:34:02.144824 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 153431us
I20260807 13:34:02.145843 5501 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.154879 5501 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.143262 9347 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:02.164727 5501 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.154287 9937 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:02.153317 9933 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:02.167372 9377 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 13:34:02.178617 9945 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.089s user 0.003s sys 0.000s
I20260807 13:34:02.179260 9354 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.181666 5501 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
W20260807 13:34:02.183723 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 67622.7us
W20260807 13:34:02.185716 9929 log.cc:924] Time spent T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.139s user 0.002s sys 0.000s
I20260807 13:34:02.167480 9829 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.193028 5501 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.194442 5501 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.197829 5618 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:02.198931 9942 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:02.199066 9956 consensus_queue.cc:1046] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:34:02.200073 9956 consensus_queue.cc:1225] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260807 13:34:02.200320 9936 log.cc:924] Time spent T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.133s user 0.001s sys 0.000s
I20260807 13:34:02.200544 9377 raft_consensus.cc:3032] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:02.203636 5501 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.204674 9942 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.205268 9863 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:02.205657 9863 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:02.206004 9863 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:02.206040 9354 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.168195 9924 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:02.207083 5501 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.209961 5501 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.211778 5501 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.214982 5618 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:02.208010 9956 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:34:02.218015 5618 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:02.202980 9377 raft_consensus.cc:729] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:02.201102 9937 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:02.253371 5501 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.256182 5618 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:02.256608 9904 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:34:02.258040 5618 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:02.260165 5501 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:02.260890 5618 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:02.211117 9925 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:02.211143 9942 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.264662 9377 consensus_queue.cc:260] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.266335 9377 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:02.271911 9843 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.272958 5762 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:34:02.207748 9836 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.274891 5767 raft_consensus.cc:1226] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 3. Current term is 4. Ops: []
I20260807 13:34:02.275847 9836 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.276469 9933 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:02.279214 9347 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.280012 9422 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.281158 9347 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.262333 5501 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.264259 9956 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:02.252296 9896 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.288329 9827 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:02.289840 9904 raft_consensus.cc:686] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.292407 9925 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.293120 5501 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.315855 5501 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.317077 5501 leader_election.cc:302] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:34:02.298190 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 331591us
I20260807 13:34:02.254971 9924 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:02.318809 9917 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:02.319505 9848 raft_consensus.cc:2726] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.321697 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.321902 5501 leader_election.cc:398] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:02.321951 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.322398 5501 leader_election.cc:401] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:34:02.302616 5765 raft_consensus.cc:1226] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:02.281888 9422 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.327948 5722 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.323242 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.324879 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.293918 9920 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.329947 5722 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:02.330855 5501 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.332459 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.304622 9843 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.333817 5501 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.331792 9354 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:02.335671 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.289737 9776 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.341511 5722 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.329130 9925 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:02.343417 5501 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.344921 5501 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.329779 9846 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:02.354183 5501 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:02.329281 9827 raft_consensus.cc:686] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.326930 9061 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.363437 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:02.365518 9941 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:02.340899 9354 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.393767 9354 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.366781 9956 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:02.368247 5555 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260807 13:34:02.368983 9904 consensus_queue.cc:237] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.370287 9943 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.370642 9899 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:02.396744 9899 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:02.397135 9899 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:02.340291 9924 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 13:34:02.372273 9932 log.cc:924] Time spent T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.217s user 0.000s sys 0.003s
I20260807 13:34:02.372610 9939 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260807 13:34:02.373210 9954 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:02.403155 5667 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 13:34:02.374858 9776 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.375463 9920 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:02.376111 9925 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 13:34:02.378136 9422 raft_consensus.cc:2781] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 13:34:02.403944 9061 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.406786 9739 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 13:34:02.410621 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.378196 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.382987 9827 consensus_queue.cc:237] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.357179 9937 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.384362 9946 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:02.413345 9946 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.413800 9946 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:02.414467 5544 raft_consensus.cc:1226] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:02.404217 9422 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:02.417166 9422 raft_consensus.cc:3037] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:34:02.384642 5722 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.335809 9917 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:02.419983 5553 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:02.420737 5722 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:02.391942 5659 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:02.425318 5722 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:02.427557 5765 raft_consensus.cc:1226] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:02.428838 5544 raft_consensus.cc:1261] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260807 13:34:02.429217 5544 pending_rounds.cc:76] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 4
I20260807 13:34:02.429415 5544 pending_rounds.cc:97] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260807 13:34:02.429633 5544 raft_consensus.cc:2866] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:02.430143 9928 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:02.430578 9928 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:02.430405 9863 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.430970 9928 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:02.431223 5762 raft_consensus.cc:1226] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:02.432484 9863 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:02.432339 9354 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.438094 5722 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.440480 5769 raft_consensus.cc:1261] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 13:34:02.441987 5762 raft_consensus.cc:1226] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:34:02.442649 5556 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:34:02.444203 9940 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.444854 5661 raft_consensus.cc:1261] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:34:02.448743 9917 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:02.449246 9917 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:02.426865 9836 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:02.456519 5722 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.458892 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:02.470338 9843 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:02.461783 9777 consensus_queue.cc:1046] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260807 13:34:02.470883 9843 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.471006 9354 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.471304 9843 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:02.472777 5762 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe"
dest_uuid: "737c581af06a42df94970a1542600159"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:43388
I20260807 13:34:02.473340 5762 raft_consensus.cc:595] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.474524 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:34:02.477097 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 121803us
I20260807 13:34:02.478415 5556 raft_consensus.cc:1261] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 13:34:02.479717 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:02.487108 5770 raft_consensus.cc:1261] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260807 13:34:02.459559 9836 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.486791 5722 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:02.496829 5722 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
W20260807 13:34:02.544675 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 66386.5us
I20260807 13:34:02.477682 9807 consensus_queue.cc:1035] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260807 13:34:02.496410 9836 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:02.479866 9931 consensus_queue.cc:1035] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260807 13:34:02.499537 9347 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.491714 9831 consensus_queue.cc:1046] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260807 13:34:02.546801 6637 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:02.494321 9925 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:02.545787 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 53997.5us
W20260807 13:34:02.564033 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 52874.1us
I20260807 13:34:02.494051 9354 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260807 13:34:02.568307 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 44384.7us
I20260807 13:34:02.544791 9061 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:02.521684 9920 consensus_queue.cc:1035] T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260807 13:34:02.580912 9825 consensus_queue.cc:1046] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 13:34:02.583702 9825 raft_consensus.cc:3032] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 13:34:02.584043 9825 raft_consensus.cc:729] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.584827 9825 consensus_queue.cc:260] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.573674 9940 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 13:34:02.586728 9962 log.cc:924] Time spent T 5aa7518c16b1482b87aa72990193cafd P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.107s user 0.000s sys 0.000s
I20260807 13:34:02.587630 9896 consensus_queue.cc:1046] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260807 13:34:02.593794 9896 raft_consensus.cc:3032] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:34:02.594211 9896 raft_consensus.cc:729] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.574477 9354 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.585969 9825 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:34:02.576450 9061 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.606613 9896 consensus_queue.cc:260] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.608943 5722 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.595477 9976 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:02.612923 9347 consensus_queue.cc:1046] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:02.607798 9937 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:02.614598 5722 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.614562 9937 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.616314 5722 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.616719 9937 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:02.618194 9776 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:02.618790 9776 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.619200 9776 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.619313 9896 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:02.621371 9946 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.575101 9925 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.608229 9354 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:02.624580 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:02.618814 9815 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:02.618281 9777 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:02.626161 9061 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:34:02.627851 9965 log.cc:924] Time spent T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20260807 13:34:02.630148 9899 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.613454 9422 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:02.644814 9318 consensus_queue.cc:1046] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:02.654572 9934 consensus_queue.cc:1046] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260807 13:34:02.657270 9925 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:02.657473 9843 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.669299 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:02.674710 6693 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:02.675540 9843 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.659125 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:02.642498 9917 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:34:02.665099 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 118377us
I20260807 13:34:02.646140 9815 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.658388 9777 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:34:02.677001 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 154339us
I20260807 13:34:02.690753 5770 raft_consensus.cc:1226] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:02.677101 5503 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:02.683051 5761 raft_consensus.cc:1226] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:02.691036 5618 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:02.683799 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:02.685317 5767 raft_consensus.cc:1226] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 2. Current term is 3. Ops: []
I20260807 13:34:02.687002 9917 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:02.686884 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 59944.1us
I20260807 13:34:02.683538 5764 raft_consensus.cc:1226] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:02.696193 5764 raft_consensus.cc:1226] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:02.696729 5722 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.690490 9815 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:02.693729 9777 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.721225 5722 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.680459 9904 consensus_queue.cc:1046] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260807 13:34:02.685031 9829 consensus_queue.cc:1046] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260807 13:34:02.730512 9946 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.698746 9925 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:02.752092 9925 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:02.752507 9925 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:02.708464 9917 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.759404 9917 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:02.713049 9940 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:02.718279 9931 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:02.760129 9931 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.760093 9940 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.760684 9931 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:02.762230 9940 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.757504 9354 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.720404 9861 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.745069 9830 raft_consensus.cc:3032] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:02.715324 9318 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260807 13:34:02.767248 9933 raft_consensus.cc:3032] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:02.746369 9899 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:02.767620 9933 raft_consensus.cc:729] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.724668 9928 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:02.767872 9946 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:34:02.768326 9946 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.768738 9946 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:02.768392 9933 consensus_queue.cc:260] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:02.769079 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 47957.9us
I20260807 13:34:02.769403 9928 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:02.769677 9933 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.770325 5765 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 9. Current term is 10. Ops: []
I20260807 13:34:02.747830 9422 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:02.755349 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.755719 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:02.772305 5666 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:02.756337 5658 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "93d548887d4245c7b22072e49517a84f"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "737c581af06a42df94970a1542600159"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:34:02.773156 5658 raft_consensus.cc:595] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Received request to transfer leadership to TS 737c581af06a42df94970a1542600159
I20260807 13:34:02.773419 9980 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:34:02.756844 9979 consensus_queue.cc:1046] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:34:02.769814 5722 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.774328 9980 raft_consensus.cc:3032] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 LEADER]: Stepping down as leader of term 9
I20260807 13:34:02.774715 9940 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:02.774807 9979 raft_consensus.cc:3032] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 13:34:02.775174 9940 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.716889 9934 consensus_queue.cc:1046] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260807 13:34:02.779068 9824 raft_consensus.cc:3032] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:02.779150 9940 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:02.779505 9824 raft_consensus.cc:729] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.779979 9897 raft_consensus.cc:3032] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:02.780390 9897 raft_consensus.cc:729] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.780328 9824 consensus_queue.cc:260] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.781288 9897 consensus_queue.cc:260] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.742986 9976 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:02.763200 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:02.771624 9829 raft_consensus.cc:3032] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:34:02.775249 9979 raft_consensus.cc:729] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:34:02.775797 9941 consensus_queue.cc:1046] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:34:02.776505 9899 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:02.771493 9061 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.781813 9824 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.799839 5389 catalog_manager.cc:5495] T 5fee77ea2bf842b780a8cbcaf0698bc3 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:34:02.757071 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:02.777215 9819 consensus_queue.cc:1035] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:02.774716 9980 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:34:02.808902 9980 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:02.765345 9830 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:34:02.810667 9830 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:02.811527 9354 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.811848 5771 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:02.812065 9830 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:02.812350 9941 raft_consensus.cc:3032] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:02.812860 9061 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.776849 5618 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:02.814494 9899 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.802654 5767 raft_consensus.cc:1226] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:02.800024 5722 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:02.817624 5548 raft_consensus.cc:1261] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 13:34:02.817886 5722 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:02.819505 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:02.806571 9897 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.812736 9941 raft_consensus.cc:729] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.762377 9815 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.838223 9941 consensus_queue.cc:260] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.838742 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:02.830444 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.827873 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:02.839478 9941 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.843009 5722 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:02.843715 9061 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.841786 9836 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.843974 9980 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:02.844590 5766 raft_consensus.cc:1226] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:02.845564 9836 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.846076 9836 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:02.849665 9354 consensus_queue.cc:1046] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:02.782328 9834 raft_consensus.cc:3032] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:02.850616 9422 raft_consensus.cc:979] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159: : Instructing follower 0b9aca0aafaa43e7998ee8f3e59627e0 to start an election
I20260807 13:34:02.850754 9354 raft_consensus.cc:3032] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:02.851114 9354 raft_consensus.cc:729] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:02.852123 9985 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:02.852605 9985 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:02.852990 9985 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:02.851132 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:02.851172 9422 raft_consensus.cc:1067] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Signalling peer 0b9aca0aafaa43e7998ee8f3e59627e0 to start an election
I20260807 13:34:02.852075 9354 consensus_queue.cc:260] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.827503 9829 raft_consensus.cc:729] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.859961 9829 consensus_queue.cc:260] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.861285 9829 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:02.785148 9299 raft_consensus.cc:3032] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:02.862385 9299 raft_consensus.cc:729] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:02.863459 9299 consensus_queue.cc:260] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.865150 9299 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:02.810668 9979 consensus_queue.cc:260] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:02.864274 9925 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:02.850718 9834 raft_consensus.cc:729] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.870151 9917 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:02.871004 9925 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:02.870677 9917 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.870544 9834 consensus_queue.cc:260] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.872540 9834 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:02.873273 9917 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:02.874308 9917 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:02.878628 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:02.885629 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:02.885835 5548 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260807 13:34:02.886270 6696 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:02.886348 5548 pending_rounds.cc:76] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 4
I20260807 13:34:02.886819 5548 pending_rounds.cc:97] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260807 13:34:02.887107 5548 raft_consensus.cc:2866] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:02.874811 9917 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.896386 5620 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:02.887616 9939 consensus_queue.cc:1035] T 9a473fdcfed54f57b127f9f85d46c8ea P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260807 13:34:02.901165 9824 consensus_queue.cc:1046] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:02.899415 9934 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:02.901975 9815 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.901746 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.855119 9899 consensus_queue.cc:1046] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260807 13:34:02.902390 9934 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:02.903324 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.887812 9861 consensus_queue.cc:1046] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260807 13:34:02.904425 9934 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:02.905969 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.925083 5658 raft_consensus.cc:1226] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:02.906575 5553 raft_consensus.cc:1203] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-9.6] Dedup: 6.4->[7.5-9.6]
I20260807 13:34:02.925751 5553 pending_rounds.cc:76] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 4
I20260807 13:34:02.925994 5553 pending_rounds.cc:97] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260807 13:34:02.926249 5553 raft_consensus.cc:2866] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:02.908401 9899 raft_consensus.cc:3032] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:02.904409 9861 raft_consensus.cc:3032] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:02.909166 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:02.910050 9824 raft_consensus.cc:3032] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:02.895123 9354 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:02.912354 9061 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:02.920719 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.921545 5389 catalog_manager.cc:5495] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 4 to 6, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 6 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:34:02.922415 5659 raft_consensus.cc:1226] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:02.923166 9979 raft_consensus.cc:3037] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:34:02.904414 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.931567 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.931761 6696 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 10.
I20260807 13:34:02.932734 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.939090 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:02.942437 5663 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:02.956007 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.846737 9776 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.946218 6685 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:02.947212 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.934870 9899 raft_consensus.cc:729] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.957965 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.960508 5503 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:02.961562 5764 raft_consensus.cc:1226] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:02.970252 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:02.970726 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.971853 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.972856 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.963927 9318 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260807 13:34:02.974852 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.976338 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.972167 9899 consensus_queue.cc:260] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.977669 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.981998 5722 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:02.973912 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.941733 9861 raft_consensus.cc:729] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.987388 5722 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:02.943343 9824 raft_consensus.cc:729] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:02.928568 9777 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.004901 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.019081 5722 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.026288 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:03.021572 9899 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:03.008626 9843 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.020s
I20260807 13:34:03.027395 5662 raft_consensus.cc:1226] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:02.958689 9934 consensus_queue.cc:1046] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260807 13:34:03.027664 9824 consensus_queue.cc:260] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.025830 9933 raft_consensus.cc:3032] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:03.029161 9933 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.029353 9934 raft_consensus.cc:3032] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:03.029503 9824 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:03.029843 9934 raft_consensus.cc:729] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.029946 9933 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.030692 9934 consensus_queue.cc:260] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.031479 9933 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:02.960987 9827 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 13:34:03.031889 9934 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:02.994621 9985 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:02.980135 9943 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:03.034562 9943 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.036270 9985 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:02.982148 9851 consensus_queue.cc:1046] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260807 13:34:03.020244 5722 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.037197 9061 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:34:03.037747 9851 raft_consensus.cc:3032] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:03.036636 9943 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:03.037916 9061 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 13:34:02.993209 5621 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:03.039319 9819 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:03.039701 9819 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:03.039975 9777 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:03.040051 9819 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:03.021763 9354 raft_consensus.cc:2726] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:03.041857 5722 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:34:03.042498 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 55946.5us
I20260807 13:34:03.024626 5666 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:52582
I20260807 13:34:03.044137 5666 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:34:03.044490 5666 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:03.039944 6693 raft_consensus.cc:2454] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 3.
I20260807 13:34:03.046293 9354 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:03.047626 9917 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:03.049556 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:02.896128 9946 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.049901 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.040143 5761 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:03.055987 5618 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:03.056437 5722 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.063374 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:03.064390 5548 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
W20260807 13:34:03.066269 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 45727.4us
I20260807 13:34:03.068411 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.063836 5721 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.071650 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.074524 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.073660 5722 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.078523 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:03.079236 5662 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 10
I20260807 13:34:03.079737 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:03.019956 9925 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election won for term 10
I20260807 13:34:03.006333 9422 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:03.081290 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:03.085074 5721 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.086464 5499 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:03.088231 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:03.089147 5771 raft_consensus.cc:1226] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:03.089578 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:03.090145 5765 raft_consensus.cc:1226] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:03.086483 5721 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.055330 9851 raft_consensus.cc:729] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.095713 9985 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:34:03.096253 9851 consensus_queue.cc:260] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.097508 9851 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:03.098474 9318 raft_consensus.cc:979] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: : Instructing follower 737c581af06a42df94970a1542600159 to start an election
I20260807 13:34:03.098904 9318 raft_consensus.cc:1067] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Signalling peer 737c581af06a42df94970a1542600159 to start an election
I20260807 13:34:03.099098 9900 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 13:34:03.099503 5764 raft_consensus.cc:1226] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 4. Current term is 5. Ops: []
I20260807 13:34:03.099978 5767 raft_consensus.cc:3037] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:03.098217 9899 consensus_queue.cc:1046] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:03.101346 5769 raft_consensus.cc:1226] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:03.101857 5771 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "93d548887d4245c7b22072e49517a84f"
dest_uuid: "737c581af06a42df94970a1542600159"
from {username='slave'} at 127.0.0.1:32950
I20260807 13:34:03.102396 5771 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:34:03.102736 5721 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.102746 5771 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:03.104032 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.104318 5721 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.106920 5499 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:03.108029 5499 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:03.110126 5762 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:03.110234 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:03.110479 5499 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:03.117318 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:34:03.119946 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 46398.4us
I20260807 13:34:03.121145 5722 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.122843 5543 raft_consensus.cc:1261] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:34:03.121564 5721 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.125094 5767 raft_consensus.cc:1261] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 13:34:03.070685 5666 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.128639 5666 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:03.131053 5722 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.132377 5721 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.062510 9981 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260807 13:34:03.079041 9061 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:03.138849 5662 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 10.
I20260807 13:34:03.146965 9964 consensus_queue.cc:1046] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:03.148267 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.148936 5554 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:03.154932 9776 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:03.073549 9843 consensus_queue.cc:1046] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260807 13:34:03.128973 9928 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 13:34:03.156885 9946 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:03.156805 9861 consensus_queue.cc:260] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.117224 9943 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:03.116963 9937 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:03.109778 9777 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:03.096289 9985 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:03.161245 9939 consensus_queue.cc:1046] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:34:03.161491 9985 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:34:03.162241 9939 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 13:34:03.162972 9939 raft_consensus.cc:3032] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:03.163354 9939 raft_consensus.cc:729] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:03.163973 9931 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.165000 9917 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:03.129283 9422 raft_consensus.cc:2726] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 13:34:03.118383 9836 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:34:03.138329 9354 raft_consensus.cc:2726] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:03.154656 9940 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.148824 6680 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 10.
I20260807 13:34:03.192227 5725 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:34:03.215131 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 82826us
I20260807 13:34:03.227100 9861 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:03.230904 9985 raft_consensus.cc:2781] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 13:34:03.234625 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:03.235960 9985 raft_consensus.cc:686] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [term 3 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:03.236907 9985 consensus_queue.cc:237] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:03.240513 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:03.242324 9897 raft_consensus.cc:3032] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 13:34:03.242686 9897 raft_consensus.cc:729] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.242780 5501 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:03.243790 10019 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:03.243434 9897 consensus_queue.cc:260] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.245210 9897 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:03.153996 9819 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:03.248383 9819 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:03.254961 9825 raft_consensus.cc:3032] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:03.255349 9825 raft_consensus.cc:729] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.256151 9825 consensus_queue.cc:260] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.257287 9825 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:03.260162 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:03.260792 5767 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:34:03.227782 9843 raft_consensus.cc:2726] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:03.262225 5501 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:03.263078 9943 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:03.263460 9943 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:03.263773 9943 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:03.270678 5554 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:03.271457 5556 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260807 13:34:03.281214 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 56086.3us
I20260807 13:34:03.279016 5771 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:34:03.285259 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 174828us
W20260807 13:34:03.289865 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 51745.5us
I20260807 13:34:03.308537 5771 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:34:03.312806 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 109416us
I20260807 13:34:03.280709 9920 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:03.319001 5725 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:34:03.319881 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 188905us
I20260807 13:34:03.320623 5722 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.294507 9925 raft_consensus.cc:686] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:03.315340 9931 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:03.330802 5618 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:03.319523 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:03.288800 9900 consensus_queue.cc:1046] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260807 13:34:03.400243 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 65045us
I20260807 13:34:03.333132 5722 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.324258 9843 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 13:34:03.405031 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.405730 5544 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:03.317376 9824 consensus_queue.cc:1046] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260807 13:34:03.331763 9347 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:03.335521 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:03.410056 9836 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:03.427944 6685 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:03.418864 9939 consensus_queue.cc:260] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:03.406515 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 73463.8us
I20260807 13:34:03.429020 9939 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:03.430867 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.431677 5548 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 8: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:03.336215 9829 consensus_queue.cc:1046] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260807 13:34:03.422274 5544 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:03.330457 9834 consensus_queue.cc:1035] T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260807 13:34:03.428085 9843 raft_consensus.cc:686] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 10 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:03.436156 6685 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:03.436264 9843 consensus_queue.cc:237] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:03.437652 5725 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:03.441416 9815 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:03.442399 9815 raft_consensus.cc:686] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:03.444769 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.448752 5388 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51200 (request call id 193) took 7988 ms. Trace:
I20260807 13:34:03.333827 9422 consensus_queue.cc:1035] T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260807 13:34:03.404582 6693 raft_consensus.cc:3037] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:03.405550 9937 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:03.473651 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.480517 9931 consensus_queue.cc:1046] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.027s
I20260807 13:34:03.508018 9931 raft_consensus.cc:3032] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Stepping down as leader of term 9
I20260807 13:34:03.508569 9931 raft_consensus.cc:729] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:03.509521 9931 consensus_queue.cc:260] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.510900 9931 raft_consensus.cc:3037] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:03.519266 9946 raft_consensus.cc:3032] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:03.519805 9946 raft_consensus.cc:729] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:03.474457 9815 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:03.489279 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:03.459615 9941 raft_consensus.cc:2781] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election won for term 10
W20260807 13:34:03.545378 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 141948us
I20260807 13:34:03.546619 5499 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:03.547297 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:03.548302 5770 raft_consensus.cc:1226] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:03.533811 9920 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:03.600776 5771 raft_consensus.cc:2454] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:03.602798 5769 raft_consensus.cc:1261] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:34:03.568969 10017 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:03.568442 9940 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:03.600381 9941 raft_consensus.cc:686] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:34:03.616046 9851 consensus_meta.cc:287] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.518s user 0.005s sys 0.005s
I20260807 13:34:03.543655 9937 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:03.568282 9925 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:03.639333 5660 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:34:03.639927 5660 raft_consensus.cc:595] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.640254 5660 raft_consensus.cc:603] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:34:03.641286 5767 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:03.642530 5770 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:03.647300 9937 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:03.648363 9851 consensus_queue.cc:1046] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:03.649500 9824 raft_consensus.cc:3032] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:03.649838 9824 raft_consensus.cc:729] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.650668 9824 consensus_queue.cc:260] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.652207 9824 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:03.652658 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:03.653690 6685 raft_consensus.cc:2379] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 3: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:03.660670 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:03.607373 9920 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.662729 5501 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:03.645833 10037 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:03.645201 10036 consensus_queue.cc:1046] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:03.669580 9917 raft_consensus.cc:3037] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 2 FOLLOWER]: Advancing to term 3
I20260807 13:34:03.663659 9981 consensus_queue.cc:1046] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260807 13:34:03.462901 5388 rpcz_store.cc:276] 0807 13:33:55.460701 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:55.460927 (+ 226us) service_pool.cc:227] Handling call
0807 13:34:03.448682 (+7987755us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:34:01.666506 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:34:01.667074 (+ 568us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:34:01.667127 (+ 53us) write_op.cc:435] Acquired schema lock
0807 13:34:01.667154 (+ 27us) tablet.cc:660] Decoding operations
0807 13:34:01.667958 (+ 804us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:34:01.668053 (+ 95us) write_op.cc:641] Partition lock acquired for write op
0807 13:34:01.668077 (+ 24us) tablet.cc:683] Acquiring locks for 7 operations
0807 13:34:01.668724 (+ 647us) tablet.cc:699] Row locks acquired
0807 13:34:01.668761 (+ 37us) write_op.cc:260] PREPARE: finished
0807 13:34:01.668938 (+ 177us) write_op.cc:270] Start()
0807 13:34:01.669082 (+ 144us) write_op.cc:276] Timestamp: P: 1786109641668874 usec, L: 0
0807 13:34:01.669123 (+ 41us) op_driver.cc:331] REPLICATION: starting
0807 13:34:01.669752 (+ 629us) log.cc:842] Serialized 2927 byte log entry
0807 13:34:02.066025 (+396273us) op_driver.cc:444] REPLICATION: finished
0807 13:34:02.253968 (+187943us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b44000232cc. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f360a95 00007ff67f3614b2 00007ff682009511 00007ff682004e1a 00007ff67f4305fe 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff685d86410
0807 13:34:02.361030 (+107062us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800418120. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:34:02.361211 (+ 181us) write_op.cc:301] APPLY: starting
0807 13:34:02.361305 (+ 94us) tablet.cc:1365] starting BulkCheckPresence
0807 13:34:02.361499 (+ 194us) tablet.cc:1368] finished BulkCheckPresence
0807 13:34:02.361520 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:34:02.444512 (+ 82992us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:34:02.444801 (+ 289us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0807 13:34:02.444855 (+ 54us) write_op.cc:312] APPLY: finished
0807 13:34:02.445227 (+ 372us) log.cc:842] Serialized 58 byte log entry
0807 13:34:02.445402 (+ 175us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:34:02.445518 (+ 116us) write_op.cc:454] Released schema lock
0807 13:34:02.445584 (+ 66us) write_op.cc:341] FINISH: Updating metrics
0807 13:34:02.445895 (+ 311us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:34:02.445921 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":244349,"apply.run_cpu_time_us":3673,"apply.run_wall_time_us":85074,"num_ops":7,"prepare.queue_time_us":215523,"prepare.run_cpu_time_us":10549,"prepare.run_wall_time_us":92841,"raft.queue_time_us":253773,"raft.run_cpu_time_us":59978,"raft.run_wall_time_us":623481,"replication_time_us":390894,"spinlock_wait_cycles":31520768,"thread_start_us":585059,"threads_started":5,"wal-append.queue_time_us":146206}]]}
I20260807 13:34:03.705591 5660 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:34:03.708640 5660 raft_consensus.cc:595] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.700163 9964 raft_consensus.cc:3032] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:03.715793 9920 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:03.722010 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:03.725943 5771 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:03.681813 9943 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.730325 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:03.720613 9964 raft_consensus.cc:729] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.740455 5553 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:03.706698 9941 consensus_queue.cc:237] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.745365 5666 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "737c581af06a42df94970a1542600159"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:34:03.747094 5666 raft_consensus.cc:595] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Received request to transfer leadership to TS 737c581af06a42df94970a1542600159
I20260807 13:34:03.747458 5666 raft_consensus.cc:603] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:34:03.750607 9964 consensus_queue.cc:260] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.755158 9964 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:03.767032 5666 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:34:03.767781 5666 raft_consensus.cc:595] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Received request to transfer leadership to TS 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.767028 6685 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:03.777117 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260807 13:34:03.778947 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:34:03.779552 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:34:03.787492 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:03.788831 9946 consensus_queue.cc:260] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.783381 9981 consensus_queue.cc:1046] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260807 13:34:03.796764 10031 raft_consensus.cc:3032] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:03.797132 10031 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.764485 6693 raft_consensus.cc:2454] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:03.800866 6685 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 13:34:03.801852 9899 raft_consensus.cc:3032] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:03.802232 9899 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.802923 9899 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.804193 9899 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:03.804458 9776 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 13:34:03.805491 9943 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:03.799096 10031 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:03.806510 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:03.823297 5762 raft_consensus.cc:1226] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:03.830613 5621 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:03.831646 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:03.833153 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:03.835382 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:03.790064 9946 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:03.827692 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:03.848340 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:03.822794 9897 raft_consensus.cc:3032] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:03.822815 10031 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:03.865147 5542 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 13:34:03.866596 5501 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:03.867442 5666 raft_consensus.cc:1226] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:03.867726 5501 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:03.875816 5660 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:03.852860 9900 raft_consensus.cc:2781] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:03.879489 5721 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.878708 5658 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:03.855616 9943 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:03.882647 5761 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:03.858996 9897 raft_consensus.cc:729] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.862475 10019 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:03.897179 9825 consensus_meta.cc:287] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.639s user 0.012s sys 0.002s
I20260807 13:34:03.868690 9920 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:03.874397 9937 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:34:03.878566 10015 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:03.906641 5771 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 13:34:03.916327 5770 raft_consensus.cc:1226] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:03.854285 9827 consensus_queue.cc:1046] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260807 13:34:03.875699 9846 raft_consensus.cc:3032] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:03.875850 10017 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:03.890803 10016 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:34:03.890885 9834 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:03.914834 10015 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:03.924402 9846 raft_consensus.cc:729] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.914770 9920 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:03.951294 10043 log.cc:924] Time spent T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.184s user 0.000s sys 0.001s
I20260807 13:34:03.951490 9920 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:03.927034 9937 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:03.935943 9834 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.952977 9937 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.949251 9846 consensus_queue.cc:260] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.954839 9846 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:03.936305 9917 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 13:34:03.959281 9937 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:03.964234 9920 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:34:03.972255 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 48855.9us
I20260807 13:34:03.911410 9824 consensus_queue.cc:1046] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260807 13:34:03.893126 9943 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:03.927708 9900 raft_consensus.cc:686] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:03.914352 9829 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260807 13:34:03.964735 9920 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.984583 5721 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.995376 5721 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:03.911742 10019 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:03.947719 10015 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:03.972203 9917 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.019094 9917 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.021055 9917 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.021543 9917 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:03.998184 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.024484 5769 raft_consensus.cc:2379] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:03.994048 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:03.999739 5659 raft_consensus.cc:1226] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 LEADER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 9. Current term is 10. Ops: []
I20260807 13:34:03.994513 9834 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.003528 9827 raft_consensus.cc:979] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0: : Instructing follower 14f62bf285c448b9b7a21fabd7a5f0bf to start an election
I20260807 13:34:04.026777 9827 raft_consensus.cc:1067] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Signalling peer 14f62bf285c448b9b7a21fabd7a5f0bf to start an election
I20260807 13:34:04.026779 9422 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:03.983968 9937 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.028136 9422 raft_consensus.cc:686] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:04.028254 9937 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.029166 9422 consensus_queue.cc:237] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.004699 9824 raft_consensus.cc:3032] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:04.030268 9937 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:03.929044 10017 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.030798 9937 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.005645 9900 consensus_queue.cc:237] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:04.031271 9937 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.032146 10017 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.033042 9937 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.008980 10048 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.008773 9897 consensus_queue.cc:260] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.034664 9943 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:04.034845 9897 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:04.014496 9843 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.034253 10048 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.030365 9824 raft_consensus.cc:729] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:34:04.006314 5389 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36640 (request call id 70) took 11282 ms (client timeout 15000 ms). Trace:
I20260807 13:34:04.037741 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.041209 5542 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
from {username='slave'} at 127.0.0.1:54390
I20260807 13:34:04.055531 5542 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 13:34:04.055847 5542 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:04.056766 5767 raft_consensus.cc:2379] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.071496 5544 raft_consensus.cc:1261] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260807 13:34:04.085494 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 147373us
I20260807 13:34:04.065950 5394 catalog_manager.cc:5495] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 3, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 3 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.086226 5552 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:04.088471 5394 catalog_manager.cc:5495] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 7 to 9, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 9 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:34:04.090162 5394 catalog_manager.cc:5495] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 5, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 5 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.092473 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.093484 5769 raft_consensus.cc:2379] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.091696 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.050940 10012 raft_consensus.cc:2781] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:34:04.094898 5767 raft_consensus.cc:2379] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.096074 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.116572 5769 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.098377 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.105967 5394 catalog_manager.cc:5495] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 5 to 6, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 6 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.097621 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.119342 5394 catalog_manager.cc:5495] T 35f1738bc8ae4372b7379be9ce23052e P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 5, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 5 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:34:04.084398 9899 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.021988 9917 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.121948 5394 catalog_manager.cc:5495] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 7 to 8, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196). New cstate: current_term: 8 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:34:04.051090 9851 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260807 13:34:04.054363 5389 rpcz_store.cc:269] 0807 13:33:52.723917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:33:52.724069 (+ 152us) service_pool.cc:227] Handling call
0807 13:34:04.006236 (+11282167us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:34:03.209388 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:34:03.209992 (+ 604us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:34:03.210036 (+ 44us) write_op.cc:435] Acquired schema lock
0807 13:34:03.210061 (+ 25us) tablet.cc:660] Decoding operations
0807 13:34:03.210584 (+ 523us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:34:03.210681 (+ 97us) write_op.cc:641] Partition lock acquired for write op
0807 13:34:03.210718 (+ 37us) tablet.cc:683] Acquiring locks for 2 operations
0807 13:34:03.211115 (+ 397us) tablet.cc:699] Row locks acquired
0807 13:34:03.211149 (+ 34us) write_op.cc:260] PREPARE: finished
0807 13:34:03.211329 (+ 180us) write_op.cc:270] Start()
0807 13:34:03.211447 (+ 118us) write_op.cc:276] Timestamp: P: 1786109643211272 usec, L: 0
0807 13:34:03.211475 (+ 28us) op_driver.cc:331] REPLICATION: starting
0807 13:34:03.212258 (+ 783us) log.cc:842] Serialized 918 byte log entry
0807 13:34:03.410494 (+198236us) op_driver.cc:444] REPLICATION: finished
0807 13:34:03.767303 (+356809us) write_op.cc:301] APPLY: starting
0807 13:34:03.768657 (+ 1354us) tablet.cc:1365] starting BulkCheckPresence
0807 13:34:03.784606 (+ 15949us) tablet.cc:1368] finished BulkCheckPresence
0807 13:34:03.822480 (+ 37874us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:34:03.881142 (+ 58662us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:34:03.914043 (+ 32901us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 13:34:03.921478 (+ 7435us) write_op.cc:312] APPLY: finished
0807 13:34:03.942557 (+ 21079us) log.cc:842] Serialized 28 byte log entry
0807 13:34:03.949980 (+ 7423us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:34:03.950164 (+ 184us) write_op.cc:454] Released schema lock
0807 13:34:03.950241 (+ 77us) write_op.cc:341] FINISH: Updating metrics
0807 13:34:03.950545 (+ 304us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:34:03.950572 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158072,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":284082,"apply.run_cpu_time_us":3104,"apply.run_wall_time_us":187837,"num_ops":2,"prepare.queue_time_us":160136,"prepare.run_cpu_time_us":3248,"prepare.run_wall_time_us":19981,"replication_time_us":193379,"thread_start_us":316453,"threads_started":2}]]}
I20260807 13:34:04.131280 5394 catalog_manager.cc:5495] T a7313c1813bc4e61a0c26ee5661f0a18 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:34:04.140013 5394 catalog_manager.cc:5495] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 6 to 7, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.142086 5394 catalog_manager.cc:5495] T e0724fe2430d41e588c520b9a8228cb4 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 5 to 7, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 7 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:34:04.138643 5663 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:04.083441 9843 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.145898 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.148319 5769 raft_consensus.cc:1226] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:04.147047 5542 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.147994 5394 catalog_manager.cc:5495] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 5 to 8, leader changed from 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 8 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:34:04.154548 5542 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.150084 5618 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:04.119295 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:04.154891 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.161973 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.164332 5394 catalog_manager.cc:5495] T e25f5d92529949cb904fde2d44bd715a P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 5 to 7, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.156451 5771 raft_consensus.cc:2379] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.155596 5658 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:34:04.177210 5721 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:04.155922 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.176244 5394 catalog_manager.cc:5495] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.178574 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.135807 9900 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.179953 5660 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:04.175567 5663 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:04.179217 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:04.180387 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.180692 5499 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:04.180842 5665 raft_consensus.cc:3032] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:04.181393 5665 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:04.178367 5659 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:34:04.121886 9347 consensus_queue.cc:1035] T 5f4a8b1973984ea99cbc92ff5ba63770 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260807 13:34:04.181581 5394 catalog_manager.cc:5495] T 92946d3f971149ddbb9f81496d989dde P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 6 to 7, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 7 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:34:04.188670 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.182135 5665 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.189826 5394 catalog_manager.cc:5495] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 1 to 6, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 6 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.190681 5665 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:04.192461 5394 catalog_manager.cc:5495] T 601f17ec93374792b153deacf070cc16 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 8 to 9, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 9 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
W20260807 13:34:04.198669 10066 log.cc:924] Time spent T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.104s user 0.001s sys 0.000s
I20260807 13:34:04.201531 5665 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:04.174021 10012 raft_consensus.cc:686] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [term 5 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:04.202263 10063 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:34:04.202715 10063 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.203114 10063 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:04.202972 10012 consensus_queue.cc:237] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.133680 9899 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.207064 9899 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.184652 9941 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:04.210060 9941 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:04.210501 9941 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:04.210762 9920 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.156982 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:04.207363 9917 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.213135 5769 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:04.194741 5394 catalog_manager.cc:5495] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 7, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.221890 5394 catalog_manager.cc:5495] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 5 to 7, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.224763 5394 catalog_manager.cc:5495] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 5, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 5 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.226927 5394 catalog_manager.cc:5495] T 1c7c63e776384e4191d85c1a670fcb60 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } }
I20260807 13:34:04.155429 6693 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
W20260807 13:34:04.232431 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 46475.2us
I20260807 13:34:04.233268 5394 catalog_manager.cc:5495] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.249902 5394 catalog_manager.cc:5495] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 reported cstate change: term changed from 3 to 7, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:04.251724 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:04.252708 5769 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:04.252341 5542 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:04.135671 9824 consensus_queue.cc:260] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.259487 6680 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 13:34:04.264545 5499 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:04.265628 5499 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:04.267561 5499 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:04.247107 9939 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:34:04.273994 5503 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:04.274233 5618 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:04.270171 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.272423 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.275305 5771 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:04.275414 5665 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:04.273041 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.257346 9899 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.189684 9900 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.278268 5499 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:04.287921 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.266530 9925 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.267654 9920 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:04.262158 10016 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:04.277480 10019 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.257604 9827 consensus_queue.cc:1046] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260807 13:34:04.277565 9943 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 13:34:04.318590 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 141449us
I20260807 13:34:04.287976 10017 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:04.380066 5667 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 4.
W20260807 13:34:04.313570 10057 log.cc:924] Time spent T 1b3376f59e7e4a14ab419b67f1758cd9 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.056s user 0.000s sys 0.001s
I20260807 13:34:04.312197 9897 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:04.277707 10053 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:04.317175 10062 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:04.266458 9829 consensus_queue.cc:1159] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "737c581af06a42df94970a1542600159" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 4 } }
W20260807 13:34:04.380312 10031 consensus_meta.cc:287] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.510s user 0.009s sys 0.000s
I20260807 13:34:04.279335 10055 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 13:34:04.552645 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 274423us
I20260807 13:34:04.553928 5499 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:04.326728 9939 raft_consensus.cc:686] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:04.290866 9899 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.541723 9897 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:04.326987 9917 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:04.402622 10017 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:04.510653 10019 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.381837 9943 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.546864 10053 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.631760 5661 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:04.560988 9861 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.632390 5656 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:04.614372 10031 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.636783 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:04.641382 5556 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:04.327948 9925 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.606177 9937 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.562469 10055 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.623252 9897 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:04.588490 10048 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.625227 10017 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:04.617697 10086 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.540637 9920 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:04.625499 9943 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:04.633459 9843 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:04.632447 10053 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:04.639495 9917 raft_consensus.cc:686] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:34:04.685277 10064 log.cc:924] Time spent T ad0be1172a5341228befdfb4f3a40efd P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.359s user 0.000s sys 0.000s
I20260807 13:34:04.684935 9939 consensus_queue.cc:237] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.403519 10016 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:04.653677 10077 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.654201 10055 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:04.626598 10019 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.677407 9777 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.665815 10048 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.642419 9861 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.735450 5552 raft_consensus.cc:1261] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 13:34:04.738682 9861 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.559871 10062 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.753798 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.754508 5722 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:04.755546 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.763491 5770 raft_consensus.cc:2379] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.767804 5771 raft_consensus.cc:2379] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.772202 9900 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.772727 9900 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.773149 9900 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.774000 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.784411 5767 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:04.652801 10031 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.790800 10092 raft_consensus.cc:2726] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:04.785892 5501 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:04.791549 10092 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:04.791260 9917 consensus_queue.cc:237] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.792052 10092 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.792655 10096 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.793149 10096 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.726640 10077 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.794306 10092 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.664098 9937 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.735038 9843 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.781785 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.811913 5762 raft_consensus.cc:2379] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:34:04.800014 10012 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.002s sys 0.010s
I20260807 13:34:04.762559 10048 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.663254 10086 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:04.821919 10012 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s user 0.003s sys 0.010s
I20260807 13:34:04.762223 9777 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.813938 10092 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:04.838176 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:04.834925 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.838783 5548 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:04.835713 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:04.835738 5556 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 13:34:04.836895 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:04.837167 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.840567 5762 raft_consensus.cc:2379] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.840396 5554 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 3.
I20260807 13:34:04.828078 9896 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.845999 5552 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:04.848204 10096 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:34:04.848332 9946 consensus_meta.cc:287] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.995s user 0.010s sys 0.000s
I20260807 13:34:04.850958 6685 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260807 13:34:04.851194 10079 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:34:04.851917 10072 log.cc:924] Time spent T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.287s user 0.001s sys 0.000s
I20260807 13:34:04.851723 10079 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.854403 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:34:04.830073 9899 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.818773 9843 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.884658 9843 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:04.886009 9900 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.888809 9824 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:04.890540 9920 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:04.891399 9920 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 13:34:04.892805 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 1406) took 1062 ms. Trace:
I20260807 13:34:04.893296 5656 rpcz_store.cc:276] 0807 13:34:03.831326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:03.831438 (+ 112us) service_pool.cc:227] Handling call
0807 13:34:04.892567 (+1061129us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540024bdd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:04.892729 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1677802240}
I20260807 13:34:04.894639 5666 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 13:34:04.907451 10048 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:04.907846 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 67488.7us
I20260807 13:34:04.911031 6685 raft_consensus.cc:1261] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260807 13:34:04.911495 10094 log.cc:924] Time spent T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.120s user 0.000s sys 0.000s
I20260807 13:34:04.912067 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.912101 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.914290 5762 raft_consensus.cc:2379] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.837790 10092 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:34:04.845149 10015 consensus_meta.cc:287] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.828s user 0.006s sys 0.004s
I20260807 13:34:04.870271 9777 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:04.861733 9896 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.875644 10086 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.862182 9946 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260807 13:34:04.881247 9964 raft_consensus.cc:3032] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
W20260807 13:34:04.882653 9941 consensus_meta.cc:287] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.672s user 0.010s sys 0.001s
I20260807 13:34:04.882735 10019 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.916710 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.977747 5761 raft_consensus.cc:2379] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 9: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:04.931663 9819 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 13:34:04.932789 10069 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 13:34:04.933530 10068 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:04.903535 9897 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.934546 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
W20260807 13:34:04.941047 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 387231us
I20260807 13:34:04.943711 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.003623 5762 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:05.003667 5499 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:05.004878 5501 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:04.955497 10016 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:04.956588 10077 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.958212 9896 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:04.960005 10063 consensus_meta.cc:287] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.756s user 0.003s sys 0.006s
I20260807 13:34:04.960263 10096 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.961236 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.000511 9824 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.963974 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.026307 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.026490 5771 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:05.027034 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:04.941242 10015 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.965534 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.027935 5765 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:04.966557 10062 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.967604 10053 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.031001 5762 raft_consensus.cc:1226] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:05.028681 5620 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.032581 10053 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.968075 9937 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.902310 9846 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.033542 9846 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:04.968982 10085 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:04.973292 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:04.974020 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.035380 10085 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.035828 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1414) took 1057 ms. Trace:
I20260807 13:34:05.035843 5763 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:05.036337 5666 rpcz_store.cc:276] 0807 13:34:03.977903 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:03.978037 (+ 134us) service_pool.cc:227] Handling call
0807 13:34:04.894211 (+916174us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:04.906980 (+ 12769us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:05.035646 (+128666us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b540024bdd0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:05.035771 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2106127232}
I20260807 13:34:05.037405 10085 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.937599 10092 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:05.040019 5554 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260807 13:34:05.042491 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.042590 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.043150 5543 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:05.043490 5554 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:04.899082 10031 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.044139 10096 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.046159 10096 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:05.046641 10102 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.047115 10102 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.048305 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.004885 5499 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:05.007540 9776 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.007330 9777 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:05.049988 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 45157.1us
I20260807 13:34:05.050341 9777 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.050992 5499 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:04.944531 9925 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.052412 9777 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:04.962749 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.010299 9834 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.053303 5769 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 4.
I20260807 13:34:05.053496 9834 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.052944 9937 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:05.054715 9937 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.055228 9937 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:05.055615 9834 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.003332 10068 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.056800 10068 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:05.058326 9925 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 13:34:05.058859 9925 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.059327 9925 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Advancing to term 4
I20260807 13:34:05.061368 10015 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.017361 6685 raft_consensus.cc:2379] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 10: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:05.017695 9934 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.063169 10079 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.063014 9934 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:05.064142 5545 raft_consensus.cc:1226] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260807 13:34:05.033551 10037 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:05.009783 10055 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.066118 10037 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.066713 10037 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
W20260807 13:34:05.067797 10111 log.cc:924] Time spent T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260807 13:34:05.068988 10055 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.012228 9829 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.070806 5503 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:05.070585 9829 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.073385 9829 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:04.976329 9964 raft_consensus.cc:729] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:05.017364 10077 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:05.075672 10077 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.076299 10077 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.000168 9941 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.078480 10085 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:05.080297 9941 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.080961 5658 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:05.074889 9964 consensus_queue.cc:260] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.087816 9964 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:05.088455 9934 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:05.019078 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.052917 9824 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.090586 5661 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:05.023725 10032 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:04.965193 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.091764 5767 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:05.091614 10032 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.094602 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.032829 5620 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.095278 5660 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
W20260807 13:34:05.095533 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 62783.5us
I20260807 13:34:05.022768 10034 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.096324 10034 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.048982 10102 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.098325 10102 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:05.099009 10102 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.099972 10102 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:05.087637 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:05.094759 5665 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:05.012672 5770 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:05.025072 10063 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.050005 9776 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.108469 10040 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:05.108726 10063 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.109383 10040 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:05.124032 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1453) took 1080 ms. Trace:
I20260807 13:34:05.124401 5545 rpcz_store.cc:276] 0807 13:34:04.043742 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:04.049554 (+ 5812us) service_pool.cc:227] Handling call
0807 13:34:04.049954 (+ 400us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:05.064613 (+1014659us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:05.123764 (+ 59151us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003354d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:05.123971 (+ 207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2327340928}
W20260807 13:34:05.126904 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 299113us
I20260807 13:34:05.128124 5663 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:05.009891 10086 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:04.997016 9939 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.159709 5618 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:05.160949 5769 raft_consensus.cc:1261] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260807 13:34:05.160879 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.137173 5620 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.162829 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:05.163127 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 112242us
I20260807 13:34:05.167930 5762 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:05.168506 5765 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:05.169871 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.170714 5552 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:05.174711 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.175376 5763 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:05.148053 10086 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.094635 5554 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:05.183943 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:34:05.002031 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 228512us
I20260807 13:34:05.184684 5761 raft_consensus.cc:2379] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:05.186239 5618 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:34:05.187215 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 50148us
I20260807 13:34:05.189904 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.190387 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.190557 5665 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:05.191136 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.191758 5666 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:05.191843 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.192554 5656 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:05.171027 9824 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.240235 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.240662 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.240945 5656 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:05.171651 10063 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:05.241456 5554 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:05.268191 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.243973 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.253361 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.188205 9827 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 13:34:05.278060 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.271857 5555 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:05.280333 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.281132 5771 raft_consensus.cc:2379] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:34:05.197130 9943 consensus_meta.cc:287] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.507s user 0.013s sys 0.000s
I20260807 13:34:05.272495 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.273141 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:05.273697 9318 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:05.282521 5665 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:34:05.282925 9318 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.283682 9318 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.289296 5667 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:05.274712 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.290365 5765 raft_consensus.cc:2379] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:05.291103 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.291770 5765 raft_consensus.cc:2379] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:05.275488 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.292604 5666 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:05.275700 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.189311 10086 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:05.293473 5762 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:05.294384 9846 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.281919 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.299600 6685 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260807 13:34:05.300297 5771 raft_consensus.cc:2379] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 5: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:05.301602 10123 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.302542 10123 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.196601 10096 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.276759 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.305615 10123 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.306154 9827 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.306726 9827 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:05.281802 10063 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.309340 10063 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.310385 10032 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.310592 10034 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.307268 10096 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.311290 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:05.277359 9931 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.312218 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.310053 9943 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.314692 9943 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.294709 10129 consensus_queue.cc:1035] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.124s
I20260807 13:34:05.319041 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.320719 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.321568 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.322264 5556 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:05.251156 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.271926 5618 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:34:05.323112 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 51298.7us
I20260807 13:34:05.324182 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.324388 5501 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.324781 5767 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:05.325210 10032 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:05.325840 10032 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.326349 10032 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.327004 10034 consensus_queue.cc:1046] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 13:34:05.329838 9943 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:05.330554 9943 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:05.331271 9943 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.336481 9934 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 13:34:05.339593 10093 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:05.340251 10093 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.341287 5618 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:05.323181 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.343318 5660 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 9: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:05.347100 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.348093 5769 raft_consensus.cc:2379] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:05.348680 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.349299 5660 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:05.349741 5665 raft_consensus.cc:1261] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 13:34:05.340854 10093 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:05.352522 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.352787 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.353302 5548 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:05.353555 5763 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:05.195917 10079 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.359936 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:05.309027 9937 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.382624 9986 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.176604 9939 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.361963 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:05.362413 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.431346 5543 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:05.432273 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.432888 5543 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:05.433264 9979 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.364282 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:05.433758 9979 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:05.435765 10032 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.244061 9897 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.358570 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.312881 9931 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.444289 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:05.426556 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 71900us
I20260807 13:34:05.241922 10015 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.433665 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.445290 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:05.445979 5543 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:05.446134 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.238775 10053 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.439056 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.439410 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.337568 10037 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.446967 5666 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:34:05.438795 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.452795 5545 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:05.453117 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.453810 5665 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 7.
I20260807 13:34:05.454737 6636 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:05.363600 9981 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:05.444051 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:05.449801 5618 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:05.443575 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.455513 5766 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
W20260807 13:34:05.460821 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 111055us
W20260807 13:34:05.461869 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 163797us
I20260807 13:34:05.448633 10096 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:05.426378 10055 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.464160 10055 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.451215 10034 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.468063 10034 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.469820 5761 raft_consensus.cc:2379] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:05.470463 5618 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:05.450949 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:05.472303 5620 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.473260 5618 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:05.473205 5667 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 5.
I20260807 13:34:05.478379 5545 raft_consensus.cc:1226] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260807 13:34:05.438211 10124 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:34:05.457274 10132 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.207s user 0.005s sys 0.000s
I20260807 13:34:05.435250 10079 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.487041 5618 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:05.458954 9981 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.487835 5620 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.456022 9897 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:05.457890 10040 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:05.505062 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.498320 5499 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:05.506603 5499 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:05.508319 5499 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:05.480744 9979 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.510493 5499 leader_election.cc:302] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:05.477528 9964 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:05.516552 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.452759 9318 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.477537 9846 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 13:34:05.455556 10053 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.503587 10031 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:05.518702 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.614010 5667 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:05.471477 10016 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260807 13:34:05.509982 9825 consensus_queue.cc:1046] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
W20260807 13:34:05.617807 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 80332.7us
I20260807 13:34:05.619877 10079 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.620433 10079 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:34:05.622731 10137 log.cc:924] Time spent T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.143s user 0.000s sys 0.000s
I20260807 13:34:05.623437 9933 raft_consensus.cc:3032] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:05.623764 10117 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.623932 9933 raft_consensus.cc:729] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:05.624547 10117 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.623461 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.626748 9989 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:05.627501 9989 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.628108 9989 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:05.533041 5548 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:05.630810 10098 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.631485 10098 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.628569 9933 consensus_queue.cc:260] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.620993 10079 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:05.643715 10119 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.644208 10119 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.645751 10055 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.645993 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:05.646258 10119 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:05.645885 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:05.606473 10099 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.650507 10099 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.652638 10099 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:05.495932 10124 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.653172 10079 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:05.654081 9933 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.654754 10124 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:34:05.656594 10085 consensus_meta.cc:287] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.577s user 0.006s sys 0.007s
I20260807 13:34:05.656970 10085 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:05.657720 5542 raft_consensus.cc:1261] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260807 13:34:05.536267 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.659979 5767 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:05.536474 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.660779 5763 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:05.503432 10062 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:05.451274 10015 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.538093 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.491731 6692 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:05.430783 9986 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:05.500329 9981 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:05.518985 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.519594 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:05.689692 10099 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.690343 10099 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.489657 9941 consensus_queue.cc:1035] T 5d8130b8a41d445a89847207cfa96bfe P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260807 13:34:05.671007 10062 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.521436 9964 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.694487 10099 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:05.694708 10062 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:05.694864 9964 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Advancing to term 10
W20260807 13:34:05.696553 10068 consensus_meta.cc:287] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.639s user 0.009s sys 0.003s
I20260807 13:34:05.696791 10079 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.697259 10068 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.515935 9917 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:05.521502 10019 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:05.521287 10123 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:05.535559 10032 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.665890 10031 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.610550 5666 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260807 13:34:05.495658 9829 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:05.627033 5761 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.496618 10129 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:05.662348 5620 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.709872 10015 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.674376 5764 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:05.514184 9776 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:34:05.569119 10017 consensus_meta.cc:287] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.894s user 0.008s sys 0.007s
I20260807 13:34:05.697692 10079 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.499496 9897 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.698371 9937 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.600260 10118 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.247s
I20260807 13:34:05.703752 9939 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:34:05.659330 9834 consensus_queue.cc:1159] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "737c581af06a42df94970a1542600159" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 8 index: 6 } }
I20260807 13:34:05.707407 10086 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.676904 10124 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.711758 9318 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.719718 10053 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.726006 9964 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.730921 5548 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.612306 10063 raft_consensus.cc:2726] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 13:34:05.741730 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 287058us
I20260807 13:34:05.820178 5544 raft_consensus.cc:3037] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:05.536159 9979 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:05.818715 5761 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:05.757959 5660 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:05.766325 5725 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:34:05.828353 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 62153.5us
I20260807 13:34:05.770037 5766 raft_consensus.cc:2379] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:34:05.741695 9925 consensus_meta.cc:287] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.682s user 0.009s sys 0.009s
W20260807 13:34:05.771261 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 108991us
I20260807 13:34:05.828641 5544 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
W20260807 13:34:05.649962 10092 consensus_meta.cc:287] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.611s user 0.008s sys 0.000s
I20260807 13:34:05.768918 10031 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.707417 10034 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.741279 10019 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.756645 9934 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.754760 10123 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:34:05.791412 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 291932us
I20260807 13:34:05.857913 5722 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.829929 9939 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:05.770980 10129 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.867942 5667 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "737c581af06a42df94970a1542600159"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:34:05.868546 5667 raft_consensus.cc:595] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Received request to transfer leadership to TS 737c581af06a42df94970a1542600159
I20260807 13:34:05.868988 5667 raft_consensus.cc:603] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:34:05.765154 10098 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:34:05.782641 10077 consensus_meta.cc:287] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.706s user 0.005s sys 0.011s
I20260807 13:34:05.781607 10032 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260807 13:34:05.803231 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 313741us
I20260807 13:34:05.791985 9897 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:05.821580 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:05.876574 5666 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 10.
I20260807 13:34:05.797376 9931 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:05.772004 9827 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:05.835280 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 324834us
I20260807 13:34:05.892225 5499 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:05.789984 10017 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:05.805052 10037 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.851505 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.893514 5499 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
W20260807 13:34:05.833091 10102 consensus_meta.cc:287] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.729s user 0.013s sys 0.005s
I20260807 13:34:05.856200 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.768117 9829 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.868115 10012 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:05.871860 10129 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:05.864238 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.865347 5722 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.860019 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.870471 9939 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:05.805205 10124 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.912685 10124 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:05.914409 10068 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:05.914935 9964 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.876111 10077 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.917550 10077 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.844849 9318 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.877610 6636 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:34:05.928504 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 50984.5us
I20260807 13:34:05.874641 5764 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:05.890868 5548 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
W20260807 13:34:05.867734 9943 consensus_meta.cc:287] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.536s user 0.014s sys 0.000s
I20260807 13:34:05.863649 10123 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:05.896587 5499 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:34:05.949577 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 53055.5us
I20260807 13:34:05.950728 5499 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:05.897411 5770 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:05.867038 10036 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.861831 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:05.863365 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.961611 5767 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.860707 9986 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.871282 10032 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.833247 9979 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:05.834090 9925 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.872385 5721 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:05.901906 5763 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.902123 5542 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 10.
W20260807 13:34:05.973707 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 101395us
I20260807 13:34:05.899293 9846 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:05.903257 5552 raft_consensus.cc:2354] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
I20260807 13:34:05.838465 10092 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.902673 10034 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:05.947996 9318 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.897653 10055 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:05.990414 10055 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:05.990893 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.991230 10055 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:05.991683 5542 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:05.915585 10079 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.994674 10079 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 13:34:05.877172 10117 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.971707 10036 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.998842 10036 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.937726 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.999965 5771 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:05.856299 10019 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:05.947918 5556 raft_consensus.cc:2379] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 9: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:05.958076 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:05.956928 5661 raft_consensus.cc:2379] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 5: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:05.959911 5618 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:05.934908 9917 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.004096 9917 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:05.899410 9829 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:05.972122 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:05.974960 5721 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.015436 5553 raft_consensus.cc:2354] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8.
I20260807 13:34:05.899714 10012 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:05.939201 9939 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:05.981925 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:06.023362 5543 raft_consensus.cc:3037] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
W20260807 13:34:05.966830 10093 consensus_meta.cc:287] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.610s user 0.002s sys 0.012s
I20260807 13:34:05.901842 10159 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:05.978055 10040 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 13:34:05.987462 10034 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:05.864424 9934 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.033444 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:05.935698 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 70450.5us
I20260807 13:34:05.909744 9989 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:05.956571 10077 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:06.017040 5554 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 4.
I20260807 13:34:05.965730 10124 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:05.971062 10032 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:06.050354 9934 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.054505 10086 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.056085 10034 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:05.956894 9943 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.058056 5555 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:06.059371 9943 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.033027 10119 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:06.061107 10119 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.061602 10119 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:06.062000 9925 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.063742 10017 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:06.016564 9846 raft_consensus.cc:686] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:06.065245 10124 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.065750 10124 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:06.065872 9846 consensus_queue.cc:237] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.048177 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.070345 9979 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.071887 10040 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:06.072515 10040 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:06.032862 9931 consensus_queue.cc:1035] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260807 13:34:06.075925 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 105703us
I20260807 13:34:06.023098 10012 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:06.076951 5620 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.078560 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.079319 5764 raft_consensus.cc:2379] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 9: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:06.035881 10036 raft_consensus.cc:2781] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:06.026391 5501 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:34:06.090929 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 64625.3us
W20260807 13:34:06.027014 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 67204.1us
I20260807 13:34:06.014696 5771 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:06.018181 5763 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:06.097262 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.097661 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.097971 5771 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:06.036643 5766 raft_consensus.cc:2379] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:06.099063 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.041206 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.100096 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.041901 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.100695 5764 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:06.101218 5555 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:06.004451 10092 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.045665 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.108947 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:05.980883 10152 raft_consensus.cc:2741] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260807 13:34:06.029104 10098 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:06.121553 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:05.898947 10102 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.094707 5543 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:06.119591 5771 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:06.123394 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.123482 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.124056 5543 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:06.124287 5771 raft_consensus.cc:2354] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8.
I20260807 13:34:06.031451 9897 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.102391 5620 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.104252 5660 raft_consensus.cc:1261] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 13:34:06.131846 5620 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.132048 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.099902 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.106406 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.106477 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.133433 5620 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.133563 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.133579 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.106770 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.043696 10077 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:06.107765 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.139999 5555 raft_consensus.cc:1261] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 13:34:06.140322 5658 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:06.141001 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.141157 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:06.105520 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 130157us
I20260807 13:34:06.110512 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.047571 10159 raft_consensus.cc:686] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:06.029899 5767 raft_consensus.cc:2454] T 94e7bc4ef4d34614b8ba037cb437058c P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:06.147552 5620 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.113708 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.117381 5501 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:06.147075 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.117484 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.121462 5722 leader_election.cc:398] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
I20260807 13:34:06.098356 5763 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:06.090408 9933 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:06.114523 10086 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:06.126451 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.128590 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.155647 5542 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:06.130296 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:06.156529 5543 raft_consensus.cc:3037] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:06.134291 5552 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:06.141620 5555 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:06.032742 10093 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.141726 5658 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:06.142802 5762 raft_consensus.cc:2379] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 4: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:06.144796 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.132447 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.115600 10036 raft_consensus.cc:686] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:06.134869 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.088078 10062 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.157941 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:06.193279 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 45819.7us
I20260807 13:34:06.201391 5552 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:06.123751 6685 raft_consensus.cc:1226] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260807 13:34:06.195263 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.195709 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:06.125730 9318 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.164249 5501 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.238301 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:06.239029 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 74880.2us
I20260807 13:34:06.239081 5658 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:06.240097 5501 leader_election.cc:398] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8.
I20260807 13:34:06.240465 5501 leader_election.cc:401] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260807 13:34:06.200309 5553 raft_consensus.cc:2379] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 6: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:06.160740 5659 raft_consensus.cc:2354] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:06.159085 5771 raft_consensus.cc:3037] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:06.201859 5620 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.107348 10099 consensus_queue.cc:1035] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260807 13:34:06.157946 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.154345 9819 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:06.155293 10017 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:06.159678 9933 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.208506 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.202409 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:06.254876 5552 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:06.230645 5662 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:06.168404 5543 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:06.146155 9861 raft_consensus.cc:2781] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election won for term 9
W20260807 13:34:06.242619 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 87515.6us
I20260807 13:34:06.260618 5771 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:06.193423 9941 raft_consensus.cc:2781] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:06.245901 5665 raft_consensus.cc:2354] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:06.246796 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.283485 5555 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:06.283928 5501 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.202361 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.285526 5762 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:06.148175 10077 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:06.144381 9934 raft_consensus.cc:2781] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 13:34:06.204756 10036 consensus_queue.cc:237] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.252710 5663 raft_consensus.cc:2354] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8.
W20260807 13:34:06.255800 10163 log.cc:924] Time spent T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.211s user 0.000s sys 0.001s
I20260807 13:34:06.257361 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.198026 9827 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.231379 6696 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:06.259194 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.296612 5765 raft_consensus.cc:2379] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:06.256913 10062 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.261063 5722 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.300024 5722 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.129753 10098 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.276311 6637 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:06.254422 5542 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:06.278810 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.304071 5543 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
I20260807 13:34:06.304539 5722 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.241061 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.306020 5658 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:06.282126 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.160877 10086 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:34:06.291651 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 340993us
I20260807 13:34:06.149000 9981 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.252513 9318 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:06.253314 9819 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.309903 5499 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:06.281777 10017 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.312007 5499 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:06.315249 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.295790 9925 raft_consensus.cc:2781] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:06.316421 5766 raft_consensus.cc:2379] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:06.191036 10159 consensus_queue.cc:237] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.258379 9933 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:06.245548 10092 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:06.305106 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:06.321300 6637 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:06.322038 9986 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:34:06.301443 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.252110 10171 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8.
I20260807 13:34:06.292155 10015 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.294906 9861 raft_consensus.cc:686] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:06.323464 5771 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:06.323704 10015 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.324136 9861 consensus_queue.cc:237] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.325788 10015 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.312116 5762 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:06.307371 5722 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.328519 5722 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.329428 9931 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:06.329895 9931 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.329620 9933 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.330312 9931 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:06.330472 5771 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:06.330890 5660 raft_consensus.cc:2354] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7.
I20260807 13:34:06.331635 5620 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.332099 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.335093 5620 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.335345 5656 raft_consensus.cc:2379] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:06.338999 5499 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:06.308578 10086 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:06.305552 9941 raft_consensus.cc:686] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:06.308743 10068 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:06.368361 5552 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:06.333885 6696 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:06.343837 10032 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.311110 9819 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:06.313588 9777 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:06.313792 9989 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.334643 10120 raft_consensus.cc:2741] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260807 13:34:06.345863 9964 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:34:06.366034 9827 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 13:34:06.348692 9776 consensus_queue.cc:1046] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 13:34:06.353425 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.354552 5722 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.369741 9937 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:06.355573 5499 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:06.360153 10019 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.311564 9946 consensus_queue.cc:1035] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260807 13:34:06.310729 9318 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.309494 9934 raft_consensus.cc:686] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:06.315330 10117 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:34:06.316243 10091 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 13:34:06.377394 5503 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:06.318181 10017 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:06.376191 10077 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.339986 10099 raft_consensus.cc:2741] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260807 13:34:06.378083 9777 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.435799 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.436376 5765 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:06.436314 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:06.347959 9897 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.362985 10092 raft_consensus.cc:686] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:06.403373 9827 raft_consensus.cc:686] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:06.386022 5722 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.355203 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.373805 10171 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260807 13:34:06.491885 9931 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.493347 5765 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:06.387432 5618 leader_election.cc:398] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8.
I20260807 13:34:06.389285 10016 raft_consensus.cc:2781] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:06.391135 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.495950 5771 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:06.495038 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.395979 10123 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.397025 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.397989 9981 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.398370 5663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1786) took 1209 ms. Trace:
I20260807 13:34:06.400560 6638 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:06.509446 5663 rpcz_store.cc:276] 0807 13:34:05.189133 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:05.190157 (+ 1024us) service_pool.cc:227] Handling call
0807 13:34:06.398197 (+1208040us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540007d0d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:06.398317 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2428082944}
I20260807 13:34:06.373626 10129 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.352990 10063 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election won for term 5
I20260807 13:34:06.499518 10040 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:06.514787 10063 raft_consensus.cc:686] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:06.412415 5544 raft_consensus.cc:3037] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:06.515602 10063 consensus_queue.cc:237] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.516086 10040 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 11 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:06.492550 9819 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.518419 9819 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.518702 10012 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.520632 10012 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:06.521354 5770 raft_consensus.cc:2354] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:06.413173 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.522399 5763 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:06.522667 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.387460 10102 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.523351 5765 raft_consensus.cc:2354] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9.
I20260807 13:34:06.420518 10017 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:06.387866 9937 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.408144 10098 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:06.407439 10091 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.410184 10055 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.531127 10119 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.531733 10091 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:06.532269 5762 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:06.533130 10055 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.422806 9934 consensus_queue.cc:237] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.523994 9937 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:06.536406 5554 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:06.405234 9318 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:06.425128 10117 raft_consensus.cc:686] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:06.427033 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.429296 10152 raft_consensus.cc:3032] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:06.430238 10093 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.433054 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.439841 5499 leader_election.cc:398] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:06.556185 5666 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:34:06.556546 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 117374us
I20260807 13:34:06.507196 10120 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:06.442700 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:06.412504 10031 consensus_meta.cc:287] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.557s user 0.009s sys 0.000s
I20260807 13:34:06.443104 5767 raft_consensus.cc:1261] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 13:34:06.364838 9925 raft_consensus.cc:686] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:06.573176 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.573305 9925 consensus_queue.cc:237] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.378368 9917 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.445302 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52574 (request call id 1797) took 1172 ms. Trace:
I20260807 13:34:06.440963 9941 consensus_queue.cc:237] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.481009 5389 catalog_manager.cc:5495] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 4 to 7, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 7 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:34:06.480911 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.473271 10077 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.444614 10053 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election won for term 8
W20260807 13:34:06.443974 10169 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.362s user 0.004s sys 0.000s
I20260807 13:34:06.460937 10032 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.474320 9829 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.557385 10152 raft_consensus.cc:729] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:06.473526 10019 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.472741 10124 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.440748 9777 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:06.474378 10092 consensus_queue.cc:237] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.481914 5553 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:06.369596 10068 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.493916 5618 leader_election.cc:401] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260807 13:34:06.494692 5620 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.391647 9964 raft_consensus.cc:686] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:06.600209 9964 consensus_queue.cc:237] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.394953 10079 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:06.602481 10079 raft_consensus.cc:686] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:06.603394 10079 consensus_queue.cc:237] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.500453 10016 raft_consensus.cc:686] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:06.606777 10016 consensus_queue.cc:237] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.505439 9933 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.506680 5665 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:34:06.507056 5548 raft_consensus.cc:3037] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:06.507539 9827 consensus_queue.cc:237] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.501749 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.614542 5764 raft_consensus.cc:2379] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:34:06.510241 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 109801us
W20260807 13:34:06.498204 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 112291us
I20260807 13:34:06.511812 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.512451 10123 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.615655 5661 raft_consensus.cc:2379] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 8: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:06.513803 10129 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.480450 9939 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:06.514293 9986 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:06.571439 10086 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.523526 5544 raft_consensus.cc:2454] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:06.524422 5771 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:06.525858 5501 leader_election.cc:398] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9.
I20260807 13:34:06.512488 9931 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:06.576892 10031 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.533149 10119 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:06.572034 9937 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.648924 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.543233 5763 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
W20260807 13:34:06.441402 5503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 64135.2us
I20260807 13:34:06.562529 5660 raft_consensus.cc:2354] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:06.581597 5659 rpcz_store.cc:276] 0807 13:34:05.273357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:05.273699 (+ 342us) service_pool.cc:227] Handling call
0807 13:34:06.440625 (+1166926us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b540007dfd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:06.445235 (+ 4610us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1920714496}
I20260807 13:34:06.585489 5766 raft_consensus.cc:2354] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:06.585489 5666 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:06.457787 5545 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:38210
I20260807 13:34:06.571230 10120 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.599130 10068 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:06.665542 5545 raft_consensus.cc:595] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:06.667387 5665 raft_consensus.cc:2354] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:06.676841 5545 raft_consensus.cc:603] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:34:06.652837 5548 raft_consensus.cc:2454] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:06.615703 5663 raft_consensus.cc:2354] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:06.671205 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.677560 5501 leader_election.cc:401] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260807 13:34:06.681069 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 155409us
I20260807 13:34:06.681102 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.681833 5661 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:06.683847 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.680680 10123 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9.
I20260807 13:34:06.703578 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.705250 5389 catalog_manager.cc:5495] T 5f4a8b1973984ea99cbc92ff5ba63770 P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 2 to 3, leader changed from d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196) to 737c581af06a42df94970a1542600159 (127.3.187.195). New cstate: current_term: 3 leader_uuid: "737c581af06a42df94970a1542600159" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:34:06.712723 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.713680 5667 raft_consensus.cc:2379] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 6: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:06.714752 5769 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:06.590821 10053 raft_consensus.cc:686] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:06.719206 5763 raft_consensus.cc:2354] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:06.707141 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.720889 5663 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:06.667260 9829 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.634912 9917 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.795097 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:34:06.755158 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 367810us
I20260807 13:34:06.796702 6696 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 10. Current term is 11. Ops: []
I20260807 13:34:06.824072 5389 catalog_manager.cc:5495] T 3a1250a61f1842c192fd95f3a267926f P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 13:34:06.752934 5769 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:06.825618 5389 catalog_manager.cc:5495] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 13:34:06.755398 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 260805us
W20260807 13:34:06.828243 5499 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.194:42569 timed out after 1.626s (SENT) [suppressed 44 similar messages]
I20260807 13:34:06.825349 5618 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:06.672643 10120 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:34:06.832227 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 216677us
I20260807 13:34:06.833660 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.834460 5766 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:06.836849 5618 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:06.837791 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.838897 5660 raft_consensus.cc:2379] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 9: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:34:06.821345 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 117623us
I20260807 13:34:06.846892 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.847544 5769 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 7
I20260807 13:34:06.849138 5501 leader_election.cc:398] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:06.854609 5663 raft_consensus.cc:2454] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 11.
I20260807 13:34:06.849442 5501 leader_election.cc:401] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260807 13:34:06.859107 6636 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:06.787104 10015 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.878327 10015 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.761714 10031 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.878785 10102 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.842090 10036 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:06.879400 10102 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.879570 10036 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.880514 10015 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.881021 5663 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "737c581af06a42df94970a1542600159"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:34:06.881335 10102 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.762993 9933 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143) with higher term. Message: Invalid argument: T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8.
I20260807 13:34:06.866320 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:06.898597 5771 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:06.867908 5769 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:06.858502 10171 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:06.869328 10093 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.871162 10041 raft_consensus.cc:2781] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Leader election won for term 11
I20260807 13:34:06.872115 5665 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260807 13:34:06.907729 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.873651 9846 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.822408 10019 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.874388 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:06.618664 10152 consensus_queue.cc:260] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:06.874994 5620 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.874882 9931 consensus_queue.cc:1035] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260807 13:34:06.875485 5766 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 10.
I20260807 13:34:06.739461 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:06.850910 9829 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:06.917982 9829 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:06.918381 9829 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:06.876849 6696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:06.919687 6696 raft_consensus.cc:2354] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
W20260807 13:34:06.920742 10190 log.cc:924] Time spent T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.289s user 0.000s sys 0.005s
I20260807 13:34:06.922797 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.923404 5667 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:06.880012 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.924751 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.925709 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.926326 5660 raft_consensus.cc:2354] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:06.878893 9937 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.881076 9777 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.942790 5503 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:06.943322 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:06.881708 5663 raft_consensus.cc:595] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 737c581af06a42df94970a1542600159
I20260807 13:34:06.943950 5663 raft_consensus.cc:603] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:34:06.874437 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.883420 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.863863 5722 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:06.885064 5501 leader_election.cc:398] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:07.052731 5501 leader_election.cc:401] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260807 13:34:07.052639 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 188909us
I20260807 13:34:06.857653 5721 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:07.053366 5722 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters:
W20260807 13:34:07.053416 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 225281us
I20260807 13:34:06.789214 9939 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:06.761068 10123 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.790350 10055 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:06.790572 10086 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.845409 9861 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:06.901885 5394 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51228 (request call id 184) took 5903 ms. Trace:
I20260807 13:34:06.850245 10124 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:07.069555 5394 rpcz_store.cc:276] 0807 13:34:00.998703 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:00.998879 (+ 176us) service_pool.cc:227] Handling call
0807 13:34:06.901801 (+5902922us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:34:04.912293 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:34:04.912826 (+ 533us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:34:04.912861 (+ 35us) write_op.cc:435] Acquired schema lock
0807 13:34:04.912877 (+ 16us) tablet.cc:660] Decoding operations
0807 13:34:04.954133 (+ 41256us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:34:04.954212 (+ 79us) write_op.cc:641] Partition lock acquired for write op
0807 13:34:04.954249 (+ 37us) tablet.cc:683] Acquiring locks for 21 operations
0807 13:34:04.955875 (+ 1626us) tablet.cc:699] Row locks acquired
0807 13:34:04.955898 (+ 23us) write_op.cc:260] PREPARE: finished
0807 13:34:04.956060 (+ 162us) write_op.cc:270] Start()
0807 13:34:04.956198 (+ 138us) write_op.cc:276] Timestamp: P: 1786109644956008 usec, L: 0
0807 13:34:04.956216 (+ 18us) op_driver.cc:331] REPLICATION: starting
0807 13:34:04.956953 (+ 737us) log.cc:842] Serialized 8354 byte log entry
0807 13:34:05.311187 (+354234us) op_driver.cc:444] REPLICATION: finished
0807 13:34:05.558552 (+247365us) write_op.cc:301] APPLY: starting
0807 13:34:05.611677 (+ 53125us) tablet.cc:1365] starting BulkCheckPresence
0807 13:34:05.700699 (+ 89022us) tablet.cc:1368] finished BulkCheckPresence
0807 13:34:05.700883 (+ 184us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:34:05.839621 (+138738us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:34:05.839910 (+ 289us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0807 13:34:05.839948 (+ 38us) write_op.cc:312] APPLY: finished
0807 13:34:05.840359 (+ 411us) log.cc:842] Serialized 144 byte log entry
0807 13:34:05.840633 (+ 274us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:34:05.840911 (+ 278us) write_op.cc:454] Released schema lock
0807 13:34:05.841024 (+ 113us) write_op.cc:341] FINISH: Updating metrics
0807 13:34:05.841386 (+ 362us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:34:05.841424 (+ 38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5957,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":210815,"apply.run_cpu_time_us":13684,"apply.run_wall_time_us":303151,"num_ops":21,"prepare.queue_time_us":255982,"prepare.run_cpu_time_us":6131,"prepare.run_wall_time_us":76127,"replication_time_us":325898,"thread_start_us":297186,"threads_started":2}]]}
I20260807 13:34:06.617378 10091 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:06.912128 5620 leader_election.cc:302] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:07.076220 5499 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:06.926962 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:07.077311 5660 raft_consensus.cc:2379] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 10: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:06.845172 10077 consensus_queue.cc:1046] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260807 13:34:06.881349 10036 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:06.940810 5771 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:06.859688 10017 consensus_queue.cc:1035] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260807 13:34:06.959226 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 100235us
I20260807 13:34:07.057662 10079 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:06.961198 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.959317 5725 leader_election.cc:398] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Vote denied by peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077) with higher term. Message: Invalid argument: T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
I20260807 13:34:06.942806 10019 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.983002 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:06.983611 9937 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:34:06.987435 9829 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.999341 10129 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:06.908452 10093 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.999881 5666 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
W20260807 13:34:07.005918 10192 log.cc:924] Time spent T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.388s user 0.003s sys 0.000s
I20260807 13:34:07.011600 9777 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:06.942561 10041 raft_consensus.cc:686] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:34:06.972851 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:07.165525 5764 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:07.013594 9933 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:07.020982 6685 consensus_queue.cc:237] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:06.785863 10053 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:07.042891 5667 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:06.835723 9318 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:06.779172 10160 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:06.934346 10152 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:34:07.058252 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 200686us
W20260807 13:34:07.053257 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 168372us
I20260807 13:34:07.066381 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:34:07.076617 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 164609us
I20260807 13:34:07.187407 5501 leader_election.cc:398] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:07.187681 5501 leader_election.cc:401] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260807 13:34:06.915020 9846 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.077713 5499 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:07.080996 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:07.191352 5771 raft_consensus.cc:2379] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 9: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
W20260807 13:34:07.191450 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 113814us
I20260807 13:34:07.054405 10119 raft_consensus.cc:2741] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260807 13:34:06.835500 10117 consensus_queue.cc:237] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.083243 5769 raft_consensus.cc:1261] T abe57eac6430478584bb4e98bfff100f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 13:34:07.118777 5659 raft_consensus.cc:2379] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:07.149448 5663 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:07.202566 5658 raft_consensus.cc:1226] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:07.069024 10063 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:07.078945 10055 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.068663 9939 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 13:34:07.155038 5763 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 9. Current term is 10. Ops: []
I20260807 13:34:07.069640 9925 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:07.069479 9861 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:07.078377 9946 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:07.081350 10086 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:07.085136 10062 raft_consensus.cc:2781] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:07.064563 10068 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.165903 5665 raft_consensus.cc:2379] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 8: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:07.170588 6692 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 10. Current term is 11. Ops: []
I20260807 13:34:07.068929 10123 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.182960 5764 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:07.192679 5499 leader_election.cc:398] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:07.196004 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:07.197428 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:07.205231 5661 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:07.110127 5725 leader_election.cc:401] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260807 13:34:07.246979 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 303423us
W20260807 13:34:07.247370 10203 log.cc:924] Time spent T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
I20260807 13:34:07.208290 5620 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:07.218658 10063 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.251886 10063 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:07.252678 10197 log.cc:924] Time spent T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.094s user 0.001s sys 0.000s
I20260807 13:34:07.198889 10079 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:07.254338 9985 raft_consensus.cc:2726] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077) with higher term. Message: Invalid argument: T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8.
W20260807 13:34:07.254488 10202 log.cc:924] Time spent T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.220s user 0.002s sys 0.000s
I20260807 13:34:07.210896 5663 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:07.213017 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:07.215353 5721 leader_election.cc:398] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7.
I20260807 13:34:07.182392 9933 raft_consensus.cc:686] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:07.260459 5555 raft_consensus.cc:3037] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 4 FOLLOWER]: Advancing to term 5
I20260807 13:34:07.260640 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:34:07.261271 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 53065.6us
I20260807 13:34:07.220254 9846 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.163308 10129 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.199304 10015 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:07.284370 10015 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:07.284776 10015 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:07.274277 9829 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.195266 9917 raft_consensus.cc:3037] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:07.200511 10160 raft_consensus.cc:686] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
W20260807 13:34:07.216324 10196 log.cc:924] Time spent T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.244s user 0.000s sys 0.001s
W20260807 13:34:07.245636 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 53090.5us
I20260807 13:34:07.254186 10079 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.212880 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:07.255465 5721 leader_election.cc:401] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:34:07.226753 10096 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:07.266707 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:07.293041 5544 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
W20260807 13:34:07.293228 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 88157.8us
I20260807 13:34:07.271247 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.273363 5620 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:07.273576 10068 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:07.273851 10019 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.231901 9946 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 13:34:07.274257 10207 log.cc:924] Time spent T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.093s user 0.001s sys 0.000s
I20260807 13:34:07.275584 10091 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 11 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.276724 9318 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.230412 10041 consensus_queue.cc:237] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:07.279435 10129 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.281459 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:07.282557 9933 consensus_queue.cc:237] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.255311 10062 raft_consensus.cc:686] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:07.289295 5499 leader_election.cc:398] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:07.289798 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.368096 5553 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:07.232014 9861 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:07.337612 9946 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:07.247380 10093 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:07.354280 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 80985.7us
I20260807 13:34:07.275578 9934 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:07.231746 9925 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:07.370061 5552 raft_consensus.cc:1226] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:07.367766 5499 leader_election.cc:401] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:34:07.303046 10119 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7.
I20260807 13:34:07.294296 5721 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:07.375837 5555 raft_consensus.cc:1261] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 13:34:07.402140 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.402844 5555 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
W20260807 13:34:07.404100 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 114963us
I20260807 13:34:07.405128 5499 leader_election.cc:398] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:07.405473 5499 leader_election.cc:401] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:34:07.399806 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.393437 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:34:07.402690 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 108497us
I20260807 13:34:07.409356 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.401551 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.411268 5552 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 7
I20260807 13:34:07.415534 5499 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:07.416935 5721 leader_election.cc:302] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:07.419169 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.367473 9829 raft_consensus.cc:2781] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:07.421649 5499 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:07.415215 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.423804 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.428320 5552 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:07.428529 5499 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:07.303411 10096 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.419642 5555 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:07.400509 10092 raft_consensus.cc:3032] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 LEADER]: Stepping down as leader of term 10
I20260807 13:34:07.393126 10171 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:07.441352 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.439608 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.447980 5544 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:07.438967 9899 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260807 13:34:07.429692 10086 raft_consensus.cc:3037] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 7
I20260807 13:34:07.450233 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.430546 10019 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:07.451511 10019 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:07.451922 10019 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:07.409345 10012 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:07.426332 9777 raft_consensus.cc:2781] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:07.454860 9777 raft_consensus.cc:686] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:07.455750 9777 consensus_queue.cc:237] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.426617 9934 raft_consensus.cc:686] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:07.442881 10092 raft_consensus.cc:729] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:07.458910 9934 consensus_queue.cc:237] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.459347 10092 consensus_queue.cc:260] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:07.460428 10092 raft_consensus.cc:3037] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:07.465380 5553 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:07.471314 10019 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.440779 5721 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:07.477618 9939 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:07.445312 5620 leader_election.cc:302] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:07.442611 10217 raft_consensus.cc:3037] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 10
I20260807 13:34:07.485992 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:07.491001 5658 raft_consensus.cc:1261] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 13:34:07.494179 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:07.494884 5764 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:07.472618 5554 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 10.
I20260807 13:34:07.496400 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:07.497635 5762 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:07.430788 10063 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 13:34:07.428427 5542 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 8
I20260807 13:34:07.484961 5656 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 13:34:07.501336 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:07.512559 5770 raft_consensus.cc:2354] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:07.482532 5544 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:07.505643 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:07.514519 5766 raft_consensus.cc:1261] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260807 13:34:07.506886 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:07.519058 5762 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:07.521332 5766 raft_consensus.cc:1261] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260807 13:34:07.447387 9829 raft_consensus.cc:686] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:07.526942 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:07.367748 10160 consensus_queue.cc:237] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.531737 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:07.532220 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:07.542917 5763 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:07.534988 5661 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:07.527643 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:07.520449 10117 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:07.536907 10063 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:07.537896 5761 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:07.511790 10036 raft_consensus.cc:2781] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 13:34:07.544718 5667 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:07.521956 9939 raft_consensus.cc:686] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
W20260807 13:34:07.567036 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 138560us
I20260807 13:34:07.559311 5542 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:07.481309 10034 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260807 13:34:07.571677 5499 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:07.556178 10055 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.556473 10171 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:07.574925 5667 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:07.578516 5499 leader_election.cc:398] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:07.541246 10205 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260807 13:34:07.540539 10099 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260807 13:34:07.583559 5499 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:07.563768 10036 raft_consensus.cc:686] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:07.552074 10117 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.568413 9937 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:07.555305 10063 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.590247 10019 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.522807 10062 consensus_queue.cc:237] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:07.603425 10215 log.cc:924] Time spent T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.156s user 0.000s sys 0.000s
I20260807 13:34:07.614030 5620 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:07.615676 10036 consensus_queue.cc:237] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.616278 9925 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:07.617579 9318 raft_consensus.cc:3032] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260807 13:34:07.617955 9318 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:07.618697 9318 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.619851 9318 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:07.593806 10077 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 13:34:07.622259 10120 consensus_meta.cc:287] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.775s user 0.013s sys 0.000s
I20260807 13:34:07.622742 5771 raft_consensus.cc:1261] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 13:34:07.622655 10120 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.623780 10063 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.625345 10120 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:07.574755 10017 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:07.591163 9829 consensus_queue.cc:237] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:07.580662 10123 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.591614 5499 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:07.613199 5542 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 9. Current term is 10. Ops: []
I20260807 13:34:07.635514 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.641772 5766 raft_consensus.cc:1261] T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260807 13:34:07.593113 10079 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.588227 10171 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:07.721371 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 91912us
I20260807 13:34:07.685410 10086 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:07.722436 5620 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:07.644230 5764 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:07.729040 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.765517 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:07.723707 9964 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:07.683962 9939 consensus_queue.cc:237] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:07.771121 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 179557us
I20260807 13:34:07.870846 5544 raft_consensus.cc:2454] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:07.772639 5555 raft_consensus.cc:2379] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 8: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:08.285786 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 1445) took 1015 ms. Trace:
I20260807 13:34:08.290421 5554 rpcz_store.cc:276] 0807 13:34:07.270480 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:07.270956 (+ 476us) service_pool.cc:227] Handling call
0807 13:34:08.285288 (+1014332us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002b2354. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:08.285554 (+ 266us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":369163008}
I20260807 13:34:08.293807 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:08.302160 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:07.908546 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 140144us
I20260807 13:34:08.304962 5620 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:08.316587 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:07.835729 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 289847us
I20260807 13:34:07.866477 5769 raft_consensus.cc:1226] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:08.317389 5544 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7"
dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
mode: GRACEFUL
new_leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
from {username='slave'} at 127.0.0.1:38210
I20260807 13:34:08.332841 5543 raft_consensus.cc:1261] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260807 13:34:08.343201 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 301869us
I20260807 13:34:07.868381 10195 consensus_queue.cc:1035] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.477s
I20260807 13:34:07.904062 6680 raft_consensus.cc:1226] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 10. Current term is 11. Ops: []
W20260807 13:34:08.066146 10228 log.cc:924] Time spent T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.279s user 0.000s sys 0.000s
I20260807 13:34:08.355830 10120 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:07.865146 10017 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:08.359201 10017 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.364432 5556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1443) took 1104 ms. Trace:
W20260807 13:34:08.027297 10231 log.cc:924] Time spent T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.304s user 0.001s sys 0.000s
I20260807 13:34:08.113642 10087 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.370038 10087 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:34:08.002430 9946 consensus_meta.cc:287] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.572s user 0.006s sys 0.003s
I20260807 13:34:08.372846 9946 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.373564 10087 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.368981 6680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57224 (request call id 252) took 1161 ms. Trace:
I20260807 13:34:07.984460 10098 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:07.788273 10099 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:07.710274 10032 raft_consensus.cc:2781] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:07.724385 10102 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:08.380014 9985 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:08.018693 10152 consensus_meta.cc:287] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.830s user 0.010s sys 0.000s
I20260807 13:34:08.381119 9937 consensus_queue.cc:1046] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 13:34:08.001969 10171 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:08.065394 9917 consensus_meta.cc:287] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.773s user 0.009s sys 0.000s
W20260807 13:34:07.867723 10223 log.cc:924] Time spent T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.111s user 0.001s sys 0.000s
W20260807 13:34:08.148707 10224 log.cc:924] Time spent T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.259s user 0.001s sys 0.000s
W20260807 13:34:08.194896 10236 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.062s user 0.000s sys 0.001s
I20260807 13:34:08.440122 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1438) took 1182 ms. Trace:
I20260807 13:34:08.383895 9946 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:08.387722 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:08.442868 9964 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.443885 5763 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 8.
I20260807 13:34:08.390653 10092 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.445847 10092 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.449213 10092 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.390818 10255 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.450519 10255 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.021920 6692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37838 (request call id 177) took 1418 ms. Trace:
I20260807 13:34:07.770257 9933 consensus_queue.cc:1035] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.683s
I20260807 13:34:08.440610 5548 rpcz_store.cc:276] 0807 13:34:07.257735 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:07.257851 (+ 116us) service_pool.cc:227] Handling call
0807 13:34:07.272200 (+ 14349us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:07.285594 (+ 13394us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:07.285621 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:07.285994 (+ 373us) log.cc:842] Serialized 26 byte log entry
0807 13:34:07.587917 (+301923us) raft_consensus.cc:1631] Marking committed up to 8
0807 13:34:07.587980 (+ 63us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:07.588070 (+ 90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:08.439577 (+851507us) raft_consensus.cc:1671] finished
0807 13:34:08.439623 (+ 46us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:08.439913 (+ 290us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13067,"raft.queue_time_us":14080,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7083,"thread_start_us":301656,"threads_started":1,"wal-append.queue_time_us":438098}
I20260807 13:34:08.357007 10120 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.392314 6680 rpcz_store.cc:276] 0807 13:34:07.207456 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:07.207633 (+ 177us) service_pool.cc:227] Handling call
0807 13:34:07.208536 (+ 903us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:08.347814 (+1139278us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:08.368446 (+ 20632us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54005a4954. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:08.368746 (+ 300us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1599044864}
W20260807 13:34:08.408838 5553 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s user 0.002s sys 0.019s
W20260807 13:34:08.458225 5553 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s user 0.003s sys 0.019s
W20260807 13:34:08.395763 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 91226.1us
I20260807 13:34:08.052206 10117 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:07.789934 10086 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:07.881186 10093 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:07.768277 9846 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:08.412274 10017 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:08.113808 9861 consensus_meta.cc:287] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.704s user 0.010s sys 0.000s
I20260807 13:34:08.461030 9846 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:08.461633 9861 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.465137 5665 raft_consensus.cc:1226] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260807 13:34:08.465370 10032 raft_consensus.cc:686] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:08.465749 10195 consensus_queue.cc:1035] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:34:07.627604 10015 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.391546 10079 consensus_queue.cc:1046] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260807 13:34:08.414695 9899 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:08.415999 9829 raft_consensus.cc:2781] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election won for term 9
W20260807 13:34:08.066828 10229 log.cc:924] Time spent T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.235s user 0.000s sys 0.000s
W20260807 13:34:08.173280 9318 consensus_meta.cc:287] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.550s user 0.011s sys 0.002s
I20260807 13:34:08.415619 10098 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:08.173022 10217 consensus_meta.cc:287] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.653s user 0.006s sys 0.002s
W20260807 13:34:08.176412 10225 log.cc:924] Time spent T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.356s user 0.004s sys 0.000s
I20260807 13:34:07.757702 10096 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:08.504760 5721 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:08.507532 5389 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36640 (request call id 71) took 3553 ms. Trace:
I20260807 13:34:08.509078 10098 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:08.510208 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.512645 10092 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:08.513031 10087 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.513571 10092 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:08.515805 10102 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:08.517086 10092 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:08.517706 10092 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.518463 9985 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.521571 9985 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:08.411963 10099 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.524200 5660 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260807 13:34:08.435220 9917 raft_consensus.cc:2726] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 6. Current term is 7.
I20260807 13:34:08.094578 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:08.526813 10152 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.531253 5763 raft_consensus.cc:1261] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:34:08.527783 10152 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.364944 5556 rpcz_store.cc:276] 0807 13:34:07.259459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:07.259742 (+ 283us) service_pool.cc:227] Handling call
0807 13:34:07.268634 (+ 8892us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:07.268979 (+ 345us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:07.269005 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:07.399739 (+130734us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b2c000524b8. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff680d59e11 00007ff680d69442 00007ff6823b1c11 00007ff68237658a 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772
0807 13:34:07.400105 (+ 366us) log.cc:842] Serialized 26 byte log entry
0807 13:34:07.567266 (+167161us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:34:07.567307 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:07.567377 (+ 70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:08.363655 (+796278us) raft_consensus.cc:1671] finished
0807 13:34:08.363719 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:08.364145 (+ 426us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8958,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":37339008,"thread_start_us":166243,"threads_started":1,"wal-append.queue_time_us":282976}
I20260807 13:34:08.461649 9846 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:08.451956 6692 rpcz_store.cc:276] 0807 13:34:06.603517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:06.603701 (+ 184us) service_pool.cc:227] Handling call
0807 13:34:06.785632 (+181931us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:07.284218 (+498586us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:08.021631 (+737413us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54004fdb54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:08.021818 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":849898752}
I20260807 13:34:08.525403 10099 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:08.485743 5666 raft_consensus.cc:1261] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260807 13:34:08.513849 10087 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:07.866137 10123 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:08.460981 10093 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.557387 6638 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:34:08.598874 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 267135us
I20260807 13:34:08.569029 5553 raft_consensus.cc:1261] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260807 13:34:08.649138 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 98204.2us
I20260807 13:34:08.602840 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:08.654276 5556 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:08.568945 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:08.609090 5660 raft_consensus.cc:1261] T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 13:34:08.502738 9861 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.607831 10237 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.644037 9829 raft_consensus.cc:686] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:08.607661 10086 raft_consensus.cc:686] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:08.538065 9964 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.613920 10079 raft_consensus.cc:3032] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:08.686035 10079 raft_consensus.cc:729] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:08.687640 10079 consensus_queue.cc:260] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.690584 5766 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260807 13:34:08.691144 10017 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.691476 10079 raft_consensus.cc:3037] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:08.691829 10017 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.571566 10032 consensus_queue.cc:237] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.573299 10255 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.675784 10205 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260807 13:34:08.684810 5661 consensus_meta.cc:287] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 1.141s user 0.013s sys 0.010s
I20260807 13:34:08.685226 10015 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.684604 10086 consensus_queue.cc:237] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.685818 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.611786 9946 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
I20260807 13:34:08.692255 5667 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:08.683866 5769 raft_consensus.cc:1261] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 13:34:08.604358 9776 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:34:08.606202 10092 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.710493 5661 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:08.701838 10205 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:08.607472 9899 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.709451 10017 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.721688 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:08.726082 5764 raft_consensus.cc:1261] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:34:08.726774 10120 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:08.727494 5658 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:08.728677 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.726207 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52582 (request call id 1461) took 1247 ms. Trace:
I20260807 13:34:08.734540 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:08.745666 5553 raft_consensus.cc:1261] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260807 13:34:08.741084 5552 raft_consensus.cc:2454] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:08.507992 5389 rpcz_store.cc:276] 0807 13:34:04.953842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:04.954222 (+ 380us) service_pool.cc:227] Handling call
0807 13:34:08.507206 (+3552984us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0807 13:34:07.069249 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 13:34:07.216054 (+146805us) write_op.cc:432] Acquiring schema lock in shared mode
0807 13:34:07.223810 (+ 7756us) write_op.cc:435] Acquired schema lock
0807 13:34:07.225161 (+ 1351us) tablet.cc:660] Decoding operations
0807 13:34:07.253305 (+ 28144us) write_op.cc:620] Acquiring the partition lock for write op
0807 13:34:07.253366 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0807 13:34:07.253398 (+ 32us) tablet.cc:683] Acquiring locks for 4 operations
0807 13:34:07.253908 (+ 510us) tablet.cc:699] Row locks acquired
0807 13:34:07.253932 (+ 24us) write_op.cc:260] PREPARE: finished
0807 13:34:07.254103 (+ 171us) write_op.cc:270] Start()
0807 13:34:07.254255 (+ 152us) write_op.cc:276] Timestamp: P: 1786109647254049 usec, L: 0
0807 13:34:07.254275 (+ 20us) op_driver.cc:331] REPLICATION: starting
0807 13:34:07.274680 (+ 20405us) log.cc:842] Serialized 1685 byte log entry
0807 13:34:08.136951 (+862271us) op_driver.cc:444] REPLICATION: finished
0807 13:34:08.241171 (+104220us) write_op.cc:301] APPLY: starting
0807 13:34:08.241274 (+ 103us) tablet.cc:1365] starting BulkCheckPresence
0807 13:34:08.358660 (+117386us) tablet.cc:1368] finished BulkCheckPresence
0807 13:34:08.358918 (+ 258us) tablet.cc:1370] starting ApplyRowOperation cycle
0807 13:34:08.359887 (+ 969us) tablet.cc:1381] finished ApplyRowOperation cycle
0807 13:34:08.360259 (+ 372us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0807 13:34:08.360356 (+ 97us) write_op.cc:312] APPLY: finished
0807 13:34:08.360952 (+ 596us) log.cc:842] Serialized 40 byte log entry
0807 13:34:08.361349 (+ 397us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:34:08.361650 (+ 301us) write_op.cc:454] Released schema lock
0807 13:34:08.361714 (+ 64us) write_op.cc:341] FINISH: Updating metrics
0807 13:34:08.410635 (+ 48921us) write_op.cc:489] Releasing partition, row and schema locks
0807 13:34:08.423711 (+ 13076us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":231256,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":94415,"apply.run_cpu_time_us":4885,"apply.run_wall_time_us":250184,"num_ops":4,"prepare.queue_time_us":188358,"prepare.run_cpu_time_us":29853,"prepare.run_wall_time_us":469005,"raft.queue_time_us":501704,"raft.run_cpu_time_us":11508,"raft.run_wall_time_us":328355,"replication_time_us":879898,"thread_start_us":937087,"threads_started":4,"wal-append.queue_time_us":309572}]]}
I20260807 13:34:08.739324 5661 rpcz_store.cc:276] 0807 13:34:07.478776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:07.480639 (+ 1863us) service_pool.cc:227] Handling call
0807 13:34:08.726084 (+1245445us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:34:08.719269 10205 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:08.734926 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:08.735960 10087 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.758826 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:08.759615 5543 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:08.759755 5556 raft_consensus.cc:3037] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:08.734262 10123 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.762988 10123 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.763777 9946 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:08.763444 10091 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:34:08.764442 9946 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:08.762760 10099 consensus_queue.cc:1046] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:08.765656 10099 raft_consensus.cc:3032] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:08.717907 9776 raft_consensus.cc:686] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:08.766021 10099 raft_consensus.cc:729] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:08.767120 9776 consensus_queue.cc:237] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.767278 10099 consensus_queue.cc:260] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.727349 10264 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260807 13:34:08.768730 10099 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:08.771220 10092 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.771852 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 1509) took 1341 ms. Trace:
I20260807 13:34:08.772207 5552 rpcz_store.cc:276] 0807 13:34:07.430060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:07.441062 (+ 11002us) service_pool.cc:227] Handling call
0807 13:34:08.771613 (+1330551us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003c78d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:08.771774 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2396928768}
I20260807 13:34:08.747954 10102 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:08.773386 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.774518 5554 raft_consensus.cc:2396] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260807 13:34:08.774847 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.776062 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.776851 5663 raft_consensus.cc:2396] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260807 13:34:08.777319 10254 log.cc:924] Time spent T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.368s user 0.003s sys 0.000s
I20260807 13:34:08.738567 10152 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:08.785077 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:08.785593 9917 raft_consensus.cc:3032] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:08.785957 9917 raft_consensus.cc:729] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:08.787076 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.786931 9917 consensus_queue.cc:260] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.788273 9917 raft_consensus.cc:3037] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:08.791038 5552 raft_consensus.cc:1261] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 13:34:08.782934 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:08.793596 5553 raft_consensus.cc:1261] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 13:34:08.802533 5663 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:08.799944 9846 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.805699 9846 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.806437 5665 raft_consensus.cc:2354] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 9. Current term is 10.
I20260807 13:34:08.807677 5554 raft_consensus.cc:1261] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 13:34:08.779598 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:08.729732 10217 raft_consensus.cc:2726] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:08.711720 10237 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:08.820139 5542 raft_consensus.cc:1261] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 13:34:08.821098 6680 raft_consensus.cc:1226] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 10. Current term is 11. Ops: []
I20260807 13:34:08.823256 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.832576 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.823136 5666 raft_consensus.cc:1261] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 13:34:08.823978 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:08.837116 9985 consensus_queue.cc:1046] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260807 13:34:08.813565 10120 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.842684 10093 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.842587 10120 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.847934 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.849336 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.848021 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.850267 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:08.851207 6685 raft_consensus.cc:2379] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 8: Already voted for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in this term.
I20260807 13:34:08.851017 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.736861 9829 consensus_queue.cc:237] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.861130 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:08.861384 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.862128 9899 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.862329 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.862579 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.852365 10120 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:08.863402 5661 raft_consensus.cc:2379] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 10: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:08.865031 5665 raft_consensus.cc:1226] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:08.867007 9946 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:08.868050 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:08.869102 5542 raft_consensus.cc:1261] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:34:08.853072 10217 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:08.870612 10217 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.873328 10217 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.875754 5391 catalog_manager.cc:5495] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 6 to 7, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:34:08.856745 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:08.886560 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:08.890407 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 52774.5us
I20260807 13:34:08.889556 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.897572 10012 raft_consensus.cc:3032] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 10 LEADER]: Stepping down as leader of term 10
I20260807 13:34:08.898029 10012 raft_consensus.cc:729] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:08.885737 5656 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
I20260807 13:34:08.899012 10012 consensus_queue.cc:260] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:34:08.899904 10273 log.cc:924] Time spent T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.071s user 0.003s sys 0.000s
I20260807 13:34:08.903249 5542 raft_consensus.cc:1261] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:34:08.910362 10274 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:08.911865 10274 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.903636 5667 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:08.890125 10217 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:08.916628 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:08.925170 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 115248us
I20260807 13:34:08.926606 5764 raft_consensus.cc:2396] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6b8ccce5b91423b8673ddfbbf2c1b1c for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260807 13:34:08.905504 5391 catalog_manager.cc:5495] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 6, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193). New cstate: current_term: 6 leader_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } }
I20260807 13:34:08.923020 10012 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:08.938568 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.952302 5544 raft_consensus.cc:595] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Received request to transfer leadership to TS 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:08.953189 9939 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 13:34:08.953943 10274 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:08.951249 5391 catalog_manager.cc:5495] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 7 to 8, leader changed from 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 8 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
W20260807 13:34:08.962769 10279 log.cc:924] Time spent T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.104s user 0.000s sys 0.000s
I20260807 13:34:08.963963 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:08.939442 10217 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:08.978179 5545 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:08.978955 5769 raft_consensus.cc:1261] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:34:08.980070 10184 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:08.980963 10289 log.cc:924] Time spent T 03cc5aef20f549689e8b1ba7db0effed P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.077s user 0.002s sys 0.000s
I20260807 13:34:08.980710 10184 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:08.983163 10184 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:08.986281 10276 log.cc:924] Time spent T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.188s user 0.003s sys 0.000s
I20260807 13:34:08.987119 5548 raft_consensus.cc:1261] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260807 13:34:08.991473 10288 log.cc:924] Time spent T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260807 13:34:08.991863 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:08.992679 5659 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:08.994505 6638 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:08.996073 9980 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:08.996802 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 1514) took 1321 ms. Trace:
I20260807 13:34:09.001832 5545 rpcz_store.cc:276] 0807 13:34:07.675746 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:07.675888 (+ 142us) service_pool.cc:227] Handling call
0807 13:34:08.986616 (+1310728us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002b2854. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:08.996596 (+ 9980us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2449472896}
I20260807 13:34:09.002451 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.004576 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.000523 10237 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:09.001258 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.001127 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:09.007251 6692 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:09.008298 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.008785 5556 raft_consensus.cc:2454] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:09.011104 5725 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:09.011600 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:09.012427 10237 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:09.012830 10237 raft_consensus.cc:482] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:09.013182 10237 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:09.013860 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.014679 10217 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:09.017194 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:09.012430 5721 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:09.019595 5721 leader_election.cc:398] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 9. Current term is 10.
I20260807 13:34:09.014775 5662 raft_consensus.cc:2396] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260807 13:34:09.019879 5721 leader_election.cc:401] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:34:09.020660 5721 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:09.021611 5771 raft_consensus.cc:2396] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260807 13:34:09.021806 9946 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 13:34:09.019891 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.022768 9946 raft_consensus.cc:686] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [term 6 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:09.024195 9985 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 10
I20260807 13:34:09.023909 9946 consensus_queue.cc:237] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.024902 5618 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:09.025995 10098 raft_consensus.cc:2781] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:09.026628 10098 raft_consensus.cc:686] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:09.027395 5618 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:09.027688 10098 consensus_queue.cc:237] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.028254 5659 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:09.030308 10099 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.030840 10099 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.031659 10205 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:09.032931 10099 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:09.030908 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.049584 5769 raft_consensus.cc:1226] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260807 13:34:09.066196 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.070927 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.072204 10129 raft_consensus.cc:2726] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:09.072397 5766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:09.073028 9933 raft_consensus.cc:2726] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260807 13:34:09.073526 5764 raft_consensus.cc:1261] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:34:09.076946 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.078536 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.086226 10217 consensus_queue.cc:1035] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:09.088533 10205 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:09.081818 5618 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:09.054705 10099 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.095818 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:09.096468 5764 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:09.099328 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.112871 5499 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.113803 9917 raft_consensus.cc:2726] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:09.114398 5499 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.115232 9917 raft_consensus.cc:2726] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:09.116163 9917 consensus_queue.cc:1046] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:09.116482 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:09.117115 9917 raft_consensus.cc:3032] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:09.117504 9917 raft_consensus.cc:729] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:34:09.118175 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 48580.7us
I20260807 13:34:09.119020 9933 consensus_queue.cc:1035] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:34:09.119575 5722 leader_election.cc:302] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:09.120529 10184 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:09.121094 9827 consensus_queue.cc:1035] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 13:34:09.099697 9846 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.122692 10129 consensus_queue.cc:1035] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:34:09.123226 9917 consensus_queue.cc:260] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.124177 10217 consensus_queue.cc:1046] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:09.124851 10096 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.124903 9917 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:09.125499 10096 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.127556 10096 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:09.124547 10237 raft_consensus.cc:504] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:09.132931 5764 raft_consensus.cc:2454] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 9.
I20260807 13:34:09.138808 6638 leader_election.cc:302] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:09.140127 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.122627 10152 raft_consensus.cc:2741] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260807 13:34:09.146845 5769 raft_consensus.cc:2354] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 8. Current term is 9.
I20260807 13:34:09.145331 5618 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:09.151365 5499 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:09.137835 10079 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.098480 10099 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.147410 9980 raft_consensus.cc:2781] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:09.165910 10079 consensus_queue.cc:1046] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:34:09.170418 9980 raft_consensus.cc:686] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 LEADER]: Becoming Leader. State: Replica: d6b8ccce5b91423b8673ddfbbf2c1b1c, State: Running, Role: LEADER
I20260807 13:34:09.163038 10195 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.171139 5764 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:09.171780 10217 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:09.171413 9980 consensus_queue.cc:237] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:09.172442 10217 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:09.170639 10079 raft_consensus.cc:3032] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:09.173671 10079 raft_consensus.cc:729] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:09.174585 10079 consensus_queue.cc:260] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.175787 10079 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:09.146963 10274 consensus_queue.cc:1035] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260807 13:34:09.180583 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:09.182267 10217 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:09.183030 10086 raft_consensus.cc:3032] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:09.183485 10086 raft_consensus.cc:729] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:09.184507 10086 consensus_queue.cc:260] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.185801 10086 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:09.187244 10237 leader_election.cc:288] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:09.188570 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:09.189348 6692 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:09.138878 10129 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
W20260807 13:34:09.193234 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 72080.3us
I20260807 13:34:09.163230 10092 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:09.165823 10091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55926 (request call id 1) took 2148 ms. Trace:
I20260807 13:34:09.211658 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.200367 9846 consensus_queue.cc:1035] T abe57eac6430478584bb4e98bfff100f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260807 13:34:09.212536 5769 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:09.222015 5658 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8"
dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
mode: GRACEFUL
new_leader_uuid: "737c581af06a42df94970a1542600159"
from {username='slave'} at 127.0.0.1:40456
I20260807 13:34:09.222383 5770 raft_consensus.cc:1261] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 13:34:09.222641 5658 raft_consensus.cc:595] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Received request to transfer leadership to TS 737c581af06a42df94970a1542600159
I20260807 13:34:09.223049 5658 raft_consensus.cc:603] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 13:34:09.223785 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.225711 5618 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:09.226517 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.196449 10093 consensus_queue.cc:1035] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260807 13:34:09.222641 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.230886 5764 raft_consensus.cc:1261] T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260807 13:34:09.232664 10299 log.cc:924] Time spent T 507708159cfa4a0885418e218939cd02 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260807 13:34:09.233048 5501 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:09.233968 10217 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election won for term 10
I20260807 13:34:09.234553 10217 raft_consensus.cc:686] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:09.234803 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.235528 10217 consensus_queue.cc:237] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.239001 9939 consensus_queue.cc:1046] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:34:09.239818 5501 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.240607 9917 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 13:34:09.240469 10152 raft_consensus.cc:3032] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:09.241214 10152 raft_consensus.cc:729] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:09.241299 10123 consensus_queue.cc:1035] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:34:09.241972 10123 consensus_queue.cc:1225] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:34:09.250336 5501 leader_election.cc:302] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.252660 5620 leader_election.cc:398] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 8. Current term is 9.
I20260807 13:34:09.252998 5620 leader_election.cc:401] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260807 13:34:09.269873 10274 raft_consensus.cc:2726] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.270260 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.270753 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.271420 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.271943 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.272557 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.273136 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.273609 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25f5d92529949cb904fde2d44bd715a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.245023 9933 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:09.272588 5764 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
W20260807 13:34:09.274389 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 48801.6us
I20260807 13:34:09.275820 9829 consensus_queue.cc:1035] T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:09.283877 5620 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:09.252539 9985 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569) with higher term. Message: Invalid argument: T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 9. Current term is 10.
I20260807 13:34:09.287773 5499 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:09.281375 10195 raft_consensus.cc:3037] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 9
W20260807 13:34:09.307628 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 57401us
I20260807 13:34:09.242188 10152 consensus_queue.cc:260] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.274405 9933 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:09.309733 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:09.323233 5658 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:09.324903 3823 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 13:34:09.327795 3823 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260807 13:34:09.328609 3823 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260807 13:34:09.328729 10310 consensus_queue.cc:1035] T 83c1aab638794d7b89a5e2344158d7c0 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260807 13:34:09.329782 10099 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:09.298266 9917 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:09.318773 5391 catalog_manager.cc:5495] T e5ae9ad6f573417ea9bbab82087da0d6 P 0b9aca0aafaa43e7998ee8f3e59627e0 reported cstate change: term changed from 3 to 7, leader changed from 737c581af06a42df94970a1542600159 (127.3.187.195) to 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194). New cstate: current_term: 7 leader_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } health_report { overall_health: UNKNOWN } } }
I20260807 13:34:09.339943 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.295583 10184 consensus_queue.cc:1035] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260807 13:34:09.330456 9933 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:09.344437 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:34:09.345209 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 63805us
I20260807 13:34:09.205905 10091 rpcz_store.cc:276] 0807 13:34:07.017254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:07.018421 (+ 1167us) service_pool.cc:227] Handling call
0807 13:34:07.273230 (+254809us) log.cc:842] Serialized 501 byte log entry
0807 13:34:07.467654 (+194424us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54004ff9a0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682307a4f 00007ff6822f0545 00007ff6822f5771 00007ff6822f56f9 00007ff6822f5689 00007ff6822f5651 00007ff6822f481d 00007ff6886b2204 00007ff6886b2039 00007ff67f44e6b6
0807 13:34:07.470144 (+ 2490us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b180018fee0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f41bf96 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68230f416 00007ff682308daa 00007ff682308014
0807 13:34:07.470631 (+ 487us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b54004ff9a0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68230f416 00007ff682308daa 00007ff682308014 00007ff6822f0545 00007ff6822f5771 00007ff6822f56f9 00007ff6822f5689 00007ff6822f5651 00007ff6822f481d 00007ff6886b2204
0807 13:34:09.165679 (+1695048us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":21262,"raft.run_cpu_time_us":3589,"raft.run_wall_time_us":90859,"spinlock_wait_cycles":48269312,"thread_start_us":82485,"threads_started":1,"wal-append.queue_time_us":98368,"wal-append.run_cpu_time_us":1832,"wal-append.run_wall_time_us":1002591}
I20260807 13:34:09.298504 9899 consensus_queue.cc:1035] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260807 13:34:09.359228 10152 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:09.367957 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.360100 5501 leader_election.cc:398] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:09.368927 5501 leader_election.cc:401] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260807 13:34:09.372458 5761 raft_consensus.cc:2354] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8.
I20260807 13:34:09.388716 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.391583 5766 raft_consensus.cc:2454] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:09.400034 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.405531 5764 raft_consensus.cc:1226] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:09.396560 5469 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet fc6f41d0f11d4c6295bae40c23631a4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260807 13:34:09.396771 10093 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:09.404692 5722 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:09.407989 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:09.404417 6692 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:09.402482 10086 raft_consensus.cc:2726] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 9. Current term is 10.
I20260807 13:34:09.417264 5725 leader_election.cc:302] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:34:09.418968 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 84870.4us
I20260807 13:34:09.410394 9917 consensus_queue.cc:1046] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260807 13:34:09.420833 10092 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:09.421474 10092 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.423585 10092 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:09.428129 5618 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:09.429628 5618 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:09.430048 10079 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:09.410377 10217 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.430735 10079 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:09.431129 10217 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.431986 10086 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.432483 10086 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.432869 10079 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:09.432976 10217 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:09.435637 9776 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 13:34:09.435904 10096 raft_consensus.cc:2781] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:09.437820 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.439966 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:09.436354 10096 raft_consensus.cc:686] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:09.447535 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.450316 5501 leader_election.cc:302] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.450711 5761 raft_consensus.cc:1261] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 13:34:09.451215 5663 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:09.452664 10093 raft_consensus.cc:482] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:09.456640 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.459138 10032 consensus_queue.cc:1035] T 37b9562e68354bc69b54b07a09406578 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:09.438690 9899 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 13:34:09.461377 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 89861.3us
I20260807 13:34:09.462209 5722 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:09.462684 10096 consensus_queue.cc:237] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:09.464785 10195 raft_consensus.cc:2726] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 8. Current term is 9.
I20260807 13:34:09.469131 5499 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:09.444862 9776 raft_consensus.cc:686] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:09.472132 9946 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 13:34:09.468360 9917 raft_consensus.cc:2726] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:09.472798 9946 raft_consensus.cc:686] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 10 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:09.472941 9776 consensus_queue.cc:237] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.466722 10330 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:09.474534 10032 consensus_queue.cc:1035] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:34:09.453135 10093 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:09.472208 10274 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:09.464138 9933 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:09.517215 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 66958us
I20260807 13:34:09.473740 9946 consensus_queue.cc:237] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.517750 10333 consensus_queue.cc:1035] T 94e7bc4ef4d34614b8ba037cb437058c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 13:34:09.519136 10184 consensus_queue.cc:1035] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 13:34:09.513356 10274 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:09.521660 10274 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:09.517964 5501 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.499394 10086 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:09.534305 5501 leader_election.cc:302] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.535159 10217 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.535772 10217 consensus_queue.cc:1035] T e1f11d721d314b9897773816faaa3205 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:34:09.537050 10217 raft_consensus.cc:2726] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.541128 5501 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.544129 5618 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:09.550987 10086 raft_consensus.cc:2726] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.557399 5721 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:09.562857 5721 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:09.569468 5501 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.564267 9899 consensus_queue.cc:1035] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260807 13:34:09.580181 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.580794 5662 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:09.582242 5663 raft_consensus.cc:1226] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:09.583240 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.583451 5501 leader_election.cc:302] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.584606 5501 leader_election.cc:302] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.585686 5501 leader_election.cc:302] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.572556 10098 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:09.586712 10098 raft_consensus.cc:686] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:09.589159 10098 consensus_queue.cc:237] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.590517 10262 consensus_queue.cc:1035] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260807 13:34:09.591729 10079 raft_consensus.cc:2726] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.592501 10079 raft_consensus.cc:2726] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:09.592785 10274 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.560824 9846 consensus_queue.cc:1035] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260807 13:34:09.594542 9933 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:09.602639 9917 raft_consensus.cc:2726] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.602988 10093 raft_consensus.cc:504] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.602180 5501 leader_election.cc:302] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.605223 10093 leader_election.cc:288] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:09.603472 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 111456us
I20260807 13:34:09.562131 9827 raft_consensus.cc:2726] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 13:34:09.607038 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.605270 9917 raft_consensus.cc:2726] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.608781 10092 raft_consensus.cc:3032] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:09.609161 10092 raft_consensus.cc:729] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:09.609951 10092 consensus_queue.cc:260] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.611135 10092 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:09.611863 10274 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:09.576629 10096 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:09.613641 5501 leader_election.cc:302] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.616786 5501 leader_election.cc:302] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.617841 9917 raft_consensus.cc:2726] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:09.618508 9917 raft_consensus.cc:2726] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 13:34:09.618454 5501 leader_election.cc:302] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.620376 5501 leader_election.cc:398] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8.
I20260807 13:34:09.620832 10274 raft_consensus.cc:2726] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:09.621515 5501 leader_election.cc:401] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260807 13:34:09.622640 5501 leader_election.cc:302] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.624840 10086 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:09.626655 5501 leader_election.cc:302] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
W20260807 13:34:09.627882 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 170988us
I20260807 13:34:09.630896 5501 leader_election.cc:302] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.622236 9917 raft_consensus.cc:2726] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 737c581af06a42df94970a1542600159 (127.3.187.195:43427) with higher term. Message: Invalid argument: T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 7. Current term is 8.
W20260807 13:34:09.643632 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 117535us
I20260807 13:34:09.639348 10079 raft_consensus.cc:2726] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 13:34:09.644487 5621 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 56737.5us
I20260807 13:34:09.645114 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93d548887d4245c7b22072e49517a84f" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:09.652431 5666 raft_consensus.cc:1261] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:34:09.639405 10274 raft_consensus.cc:2726] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 13:34:09.664220 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:09.647724 10086 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.676271 5666 raft_consensus.cc:1261] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:34:09.665261 10123 raft_consensus.cc:2726] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:09.642694 10217 consensus_queue.cc:1046] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260807 13:34:09.686576 5620 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:09.695122 10195 raft_consensus.cc:2781] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 13:34:09.695719 10195 raft_consensus.cc:686] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:09.696647 10195 consensus_queue.cc:237] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.688123 10086 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.706931 10262 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.683305 9776 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.737668 5658 raft_consensus.cc:2454] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:09.754920 5660 raft_consensus.cc:1261] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260807 13:34:09.765019 10184 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.765532 10184 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.749315 9946 consensus_queue.cc:1046] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260807 13:34:09.767040 10012 raft_consensus.cc:3032] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:09.767431 10012 raft_consensus.cc:729] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:09.767591 10184 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:09.768400 10012 consensus_queue.cc:260] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.769569 10012 raft_consensus.cc:3037] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:09.771045 10237 consensus_queue.cc:1035] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:09.753675 9939 consensus_queue.cc:1035] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260807 13:34:09.777446 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 146583us
I20260807 13:34:09.780347 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:09.781915 5501 leader_election.cc:302] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:09.784056 5766 raft_consensus.cc:1261] T 99f11806ff494d788e869d5368f88f3b P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 13:34:09.794486 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:09.795068 5770 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:09.795285 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:09.812109 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:09.812529 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:09.756275 10262 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.815016 5553 raft_consensus.cc:3032] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:09.815488 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:09.816880 5553 raft_consensus.cc:729] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:09.846024 5548 raft_consensus.cc:1261] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 13:34:09.819399 5762 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260807 13:34:09.793936 10079 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:09.847733 5556 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:09.818526 5555 raft_consensus.cc:1261] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 13:34:09.809540 10217 raft_consensus.cc:3037] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:09.851970 5544 raft_consensus.cc:1261] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260807 13:34:09.852620 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:09.781385 9776 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.856407 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:09.801307 10120 consensus_queue.cc:1035] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260807 13:34:09.866647 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:09.867506 5544 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:09.867792 5543 raft_consensus.cc:1261] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260807 13:34:09.868206 5543 pending_rounds.cc:76] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 5
I20260807 13:34:09.868448 5543 pending_rounds.cc:97] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260807 13:34:09.868700 5543 raft_consensus.cc:2866] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:09.870497 10359 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.871080 10359 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.873261 10359 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:09.873634 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:09.848433 10360 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:09.874913 5554 raft_consensus.cc:3037] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:09.882411 10360 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.875726 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:09.902962 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:09.882686 5553 consensus_queue.cc:260] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:09.874774 10079 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:09.860380 9980 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260807 13:34:09.908133 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.049341 5548 raft_consensus.cc:2396] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260807 13:34:10.049681 5544 raft_consensus.cc:2454] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:10.027597 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:34:09.914961 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 136552us
I20260807 13:34:10.050674 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:09.917886 5556 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6b8ccce5b91423b8673ddfbbf2c1b1c in term 11.
I20260807 13:34:09.962647 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.097595 5542 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 10.
I20260807 13:34:10.104646 5553 raft_consensus.cc:3037] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
W20260807 13:34:09.940156 10350 log.cc:924] Time spent T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.188s user 0.001s sys 0.000s
I20260807 13:34:10.105165 5543 raft_consensus.cc:2454] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
W20260807 13:34:10.050942 10337 log.cc:924] Time spent T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.149s user 0.000s sys 0.001s
I20260807 13:34:10.112679 5666 raft_consensus.cc:1261] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 13:34:10.113595 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.115993 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.116475 5555 raft_consensus.cc:2454] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:10.116642 5543 raft_consensus.cc:2454] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 5.
W20260807 13:34:10.118801 10349 log.cc:924] Time spent T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.332s user 0.001s sys 0.000s
I20260807 13:34:10.122412 10359 raft_consensus.cc:482] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.907827 10086 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:10.123368 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:10.096969 10274 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:10.097252 10120 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:09.962160 10360 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:09.904585 10096 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:10.142297 5554 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
W20260807 13:34:10.133919 10367 log.cc:924] Time spent T a026eb38cd9747c89f7d1b5ba508dfe8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.206s user 0.000s sys 0.000s
W20260807 13:34:10.135074 10351 log.cc:924] Time spent T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.195s user 0.000s sys 0.000s
I20260807 13:34:10.146548 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.154744 5663 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 10.
I20260807 13:34:10.153553 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:10.155972 5666 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:10.156186 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.156704 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.156966 5554 raft_consensus.cc:2454] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:10.152221 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.161636 5660 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:10.162427 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.187057 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.198640 5665 raft_consensus.cc:2379] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 7: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
I20260807 13:34:10.198849 5552 raft_consensus.cc:2454] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:10.130745 10032 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:10.141316 9776 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:10.197526 5499 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:10.132391 9985 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:10.122949 10359 raft_consensus.cc:504] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.203990 10092 raft_consensus.cc:482] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:10.209604 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:10.296144 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 89294.4us
W20260807 13:34:10.297106 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 106338us
I20260807 13:34:10.161054 10079 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:10.150894 10120 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.311295 5552 raft_consensus.cc:1261] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260807 13:34:10.150125 10274 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:10.313050 5556 raft_consensus.cc:1261] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260807 13:34:10.339645 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 226765us
I20260807 13:34:10.310120 9985 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.342514 9985 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:10.343070 10120 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:10.346909 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.338013 5552 pending_rounds.cc:76] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 3
I20260807 13:34:10.353639 5552 pending_rounds.cc:97] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260807 13:34:10.353888 5552 raft_consensus.cc:2866] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:10.355754 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.359032 5554 raft_consensus.cc:1261] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260807 13:34:10.359383 5554 pending_rounds.cc:76] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 3
I20260807 13:34:10.359570 5554 pending_rounds.cc:97] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260807 13:34:10.359813 5554 raft_consensus.cc:2866] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:10.306907 10360 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 13:34:10.361382 5663 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260807 13:34:10.162060 10096 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.298693 10262 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:10.430197 5665 raft_consensus.cc:1261] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260807 13:34:10.430244 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.441077 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.441720 5659 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:10.286480 10032 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.445864 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.448961 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.430744 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:10.445012 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.452884 5554 raft_consensus.cc:1261] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260807 13:34:10.431981 10343 log.cc:924] Time spent T de691af34db140198cfa9694fdc8ce3f P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.088s user 0.000s sys 0.000s
W20260807 13:34:10.446545 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 95849.4us
I20260807 13:34:10.451092 5543 raft_consensus.cc:2362] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 737c581af06a42df94970a1542600159 in term 7. Re-sending same reply.
I20260807 13:34:10.453373 5554 pending_rounds.cc:76] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 3
I20260807 13:34:10.459586 5554 pending_rounds.cc:97] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260807 13:34:10.459887 5554 raft_consensus.cc:2866] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:10.426851 10360 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:10.473506 5722 leader_election.cc:302] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:10.463882 5543 raft_consensus.cc:1261] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260807 13:34:10.462020 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.466964 5763 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [term 9 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:10.350165 10092 raft_consensus.cc:504] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.444314 10123 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:10.477231 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:10.477591 5552 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:10.478466 5543 raft_consensus.cc:2362] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7. Re-sending same reply.
I20260807 13:34:10.481627 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.431556 10152 consensus_queue.cc:1035] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260807 13:34:10.475751 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.497519 5662 raft_consensus.cc:1261] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260807 13:34:10.499876 5662 pending_rounds.cc:76] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting all ops after (but not including) 4
I20260807 13:34:10.500115 5662 pending_rounds.cc:97] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260807 13:34:10.500557 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
W20260807 13:34:10.502769 5618 leader_election.cc:334] T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.561s (SENT)
I20260807 13:34:10.500466 5662 raft_consensus.cc:2866] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:10.502058 5543 raft_consensus.cc:2362] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10. Re-sending same reply.
I20260807 13:34:10.470911 10086 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:10.504309 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:10.473225 10360 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:10.504916 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.505339 5554 raft_consensus.cc:2362] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7. Re-sending same reply.
I20260807 13:34:10.447082 9829 consensus_queue.cc:1035] T fc56ae27721c4c918c12ed9b14dc2950 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260807 13:34:10.510401 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:10.507547 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.508915 5555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:10.508785 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.511691 5552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.517702 5722 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:10.518388 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.520344 5722 leader_election.cc:302] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:10.521766 5554 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 9: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:10.504526 9776 raft_consensus.cc:2781] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 13:34:10.514508 10217 consensus_meta.cc:287] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.659s user 0.005s sys 0.005s
I20260807 13:34:10.523943 5552 raft_consensus.cc:1261] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 13:34:10.524331 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:10.523588 5770 consensus_meta.cc:287] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.721s user 0.009s sys 0.000s
I20260807 13:34:10.527005 5555 raft_consensus.cc:1261] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 13:34:10.528165 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.475598 10123 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:10.531971 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "641931ccce1e4d71a725d4278f4306a1" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:10.524724 5556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:10.532958 5770 raft_consensus.cc:2454] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:10.536250 5771 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: [6.3-8.4]
I20260807 13:34:10.519515 9933 consensus_queue.cc:1035] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260807 13:34:10.539675 10123 leader_election.cc:288] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:10.540205 10123 raft_consensus.cc:482] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:10.540745 10380 raft_consensus.cc:2726] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:10.540665 10123 raft_consensus.cc:504] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.541247 5666 raft_consensus.cc:2454] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 8.
I20260807 13:34:10.541862 5656 raft_consensus.cc:1226] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:10.542492 5722 leader_election.cc:302] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:10.543649 5722 leader_election.cc:302] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:10.545814 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7750cee5180c40cd9177e29f5d41bce8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
W20260807 13:34:10.519922 10353 log.cc:924] Time spent T 507708159cfa4a0885418e218939cd02 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.410s user 0.001s sys 0.000s
I20260807 13:34:10.550216 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:10.550626 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 47893.6us
I20260807 13:34:10.550897 5543 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:10.560636 5554 raft_consensus.cc:1261] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260807 13:34:10.561098 5554 pending_rounds.cc:76] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 5
I20260807 13:34:10.561357 5554 pending_rounds.cc:97] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260807 13:34:10.561717 5554 raft_consensus.cc:2866] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:10.566989 10096 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:10.549988 9985 raft_consensus.cc:2781] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 13:34:10.567806 9985 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:10.568161 9985 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:10.569053 10123 leader_election.cc:288] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:10.569411 10012 consensus_meta.cc:287] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.799s user 0.014s sys 0.000s
I20260807 13:34:10.572866 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:10.574623 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.576545 5620 leader_election.cc:302] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:10.566447 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.577486 5761 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:10.578186 9827 raft_consensus.cc:2781] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 13:34:10.578725 9827 raft_consensus.cc:686] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:10.579728 9827 consensus_queue.cc:237] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.583801 5761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.586822 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.587638 5764 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:10.589910 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03cc5aef20f549689e8b1ba7db0effed" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.592162 5770 raft_consensus.cc:1261] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260807 13:34:10.530149 9776 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:10.596531 10359 leader_election.cc:288] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:10.596895 9776 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Advancing to term 7
W20260807 13:34:10.594653 10385 log.cc:924] Time spent T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
W20260807 13:34:10.595408 10381 log.cc:924] Time spent T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260807 13:34:10.543206 10217 raft_consensus.cc:2726] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:10.520085 10310 consensus_queue.cc:1035] T a026eb38cd9747c89f7d1b5ba508dfe8 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260807 13:34:10.582687 10372 log.cc:924] Time spent T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.428s user 0.001s sys 0.000s
I20260807 13:34:10.600586 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.514219 10086 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:10.582832 10377 log.cc:924] Time spent T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.377s user 0.000s sys 0.001s
I20260807 13:34:10.595719 10379 consensus_queue.cc:1035] T 2b0808d0c45840eb9b05a49a18515c90 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.097s
I20260807 13:34:10.569974 10012 raft_consensus.cc:2781] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:10.624382 5545 raft_consensus.cc:2354] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for earlier term 9. Current term is 10.
I20260807 13:34:10.631784 5501 leader_election.cc:302] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:10.647007 5770 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260807 13:34:10.653043 5618 leader_election.cc:334] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.625s (SENT)
I20260807 13:34:10.589993 10123 consensus_queue.cc:1046] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260807 13:34:10.632510 9899 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:10.674527 9899 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:10.675796 10369 log.cc:924] Time spent T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.240s user 0.000s sys 0.001s
I20260807 13:34:10.676632 9899 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:10.647843 10012 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:34:10.685245 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 141694us
W20260807 13:34:10.685384 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 106339us
W20260807 13:34:10.689081 6636 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.515s user 0.013s sys 0.026s
W20260807 13:34:10.689774 5725 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.580s user 0.005s sys 0.010s
W20260807 13:34:10.690160 5725 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.587s user 0.006s sys 0.010s
W20260807 13:34:10.686952 6637 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.016s sys 0.008s
W20260807 13:34:10.691923 6637 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.594s user 0.016s sys 0.008s
I20260807 13:34:10.686579 5722 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:10.693228 5499 leader_election.cc:302] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
W20260807 13:34:10.687208 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 148355us
I20260807 13:34:10.678756 10012 raft_consensus.cc:3037] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
W20260807 13:34:10.729663 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 76666us
W20260807 13:34:10.730698 5618 leader_election.cc:334] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143): Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.629s (SENT)
I20260807 13:34:10.731184 5618 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:10.728186 5499 leader_election.cc:302] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:10.688552 10032 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:10.760596 5553 consensus_meta.cc:287] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.646s user 0.011s sys 0.003s
I20260807 13:34:10.772322 5553 raft_consensus.cc:1261] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Refusing update from remote peer d6b8ccce5b91423b8673ddfbbf2c1b1c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260807 13:34:10.772842 5553 pending_rounds.cc:76] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting all ops after (but not including) 7
I20260807 13:34:10.774216 5553 pending_rounds.cc:97] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260807 13:34:10.774652 5553 raft_consensus.cc:2866] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:10.758283 10237 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:10.783946 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 53304.2us
I20260807 13:34:10.784924 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:10.789683 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 61629.2us
W20260807 13:34:10.791347 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 104830us
I20260807 13:34:10.801211 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.780367 10217 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:10.783339 9917 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260807 13:34:10.819391 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:10.845021 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 90755.3us
W20260807 13:34:10.818459 6637 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 68245.9us
I20260807 13:34:10.858004 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:10.860109 10408 raft_consensus.cc:2781] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election won for term 8
W20260807 13:34:10.861137 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 73646.2us
I20260807 13:34:10.858822 5770 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 10.
I20260807 13:34:10.866691 5620 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:10.868036 5618 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:10.873016 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.873854 5553 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 6.
I20260807 13:34:10.881408 6637 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:10.884302 10091 raft_consensus.cc:2726] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260807 13:34:10.885491 10091 consensus_queue.cc:1035] T 03cc5aef20f549689e8b1ba7db0effed P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260807 13:34:10.858556 10379 raft_consensus.cc:2781] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 13:34:10.802368 9829 consensus_queue.cc:1035] T 9675aa173f334c5f870358069a6e68f4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260807 13:34:10.801808 10388 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.182s
I20260807 13:34:10.901480 6693 raft_consensus.cc:1261] T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 9 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260807 13:34:10.803869 10237 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:10.883971 10406 raft_consensus.cc:2726] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260807 13:34:10.880501 10086 leader_election.cc:288] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:10.819191 10217 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.910722 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:10.911834 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 118874us
I20260807 13:34:10.921644 5722 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
I20260807 13:34:10.894966 10379 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:10.902637 10392 consensus_queue.cc:1035] T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260807 13:34:10.921744 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 58545.2us
I20260807 13:34:10.931847 10408 raft_consensus.cc:686] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:10.895635 9899 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:10.905437 10032 raft_consensus.cc:2781] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 13:34:10.936143 5618 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:10.909104 10376 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 13:34:10.905540 10396 raft_consensus.cc:2726] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:10.940683 5722 leader_election.cc:302] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:10.959790 10217 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:10.963074 10360 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.963434 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:10.964200 5544 raft_consensus.cc:1226] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 10. Current term is 11. Ops: []
I20260807 13:34:10.965137 10360 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:10.937711 10397 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.208s
I20260807 13:34:10.966329 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:10.922145 10414 consensus_queue.cc:1035] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260807 13:34:10.939383 10379 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:11.097069 5659 raft_consensus.cc:1226] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 LEADER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:10.937685 10086 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:10.968438 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
W20260807 13:34:10.998842 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 58256.4us
I20260807 13:34:10.996600 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:11.121606 5658 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:11.121928 5544 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 6.
I20260807 13:34:10.941382 10032 raft_consensus.cc:482] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:10.998607 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:11.123123 5553 raft_consensus.cc:2362] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8. Re-sending same reply.
W20260807 13:34:10.999240 10395 log.cc:924] Time spent T fe27c759c1d64d15b7854094a751aa1a P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.245s user 0.001s sys 0.000s
I20260807 13:34:10.946233 10402 raft_consensus.cc:3032] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Stepping down as leader of term 8
W20260807 13:34:10.999907 10401 log.cc:924] Time spent T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.092s user 0.000s sys 0.000s
I20260807 13:34:10.946983 10262 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
W20260807 13:34:10.997727 10405 log.cc:924] Time spent T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.102s user 0.000s sys 0.000s
W20260807 13:34:11.172389 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 232726us
I20260807 13:34:10.947293 10406 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:10.997632 10397 raft_consensus.cc:2781] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:11.006494 10237 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:11.125558 10032 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Advancing to term 11
W20260807 13:34:11.012063 10354 log.cc:924] Time spent T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 1.109s user 0.000s sys 0.001s
I20260807 13:34:11.104453 10446 raft_consensus.cc:482] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:11.093940 10093 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:11.189605 5658 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 11.
W20260807 13:34:11.211328 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 497337us
I20260807 13:34:11.174516 10402 raft_consensus.cc:729] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:11.001302 10437 raft_consensus.cc:2726] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:11.009826 9985 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:11.216447 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 77779.2us
I20260807 13:34:10.967341 9827 consensus_queue.cc:1035] T de691af34db140198cfa9694fdc8ce3f P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.235s
I20260807 13:34:11.011677 9776 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:10.996940 10378 consensus_queue.cc:1035] T fc6f41d0f11d4c6295bae40c23631a4a P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.345s
I20260807 13:34:11.218556 5721 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:11.201225 10397 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:11.199519 10102 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.112682 10408 consensus_queue.cc:237] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.224850 10386 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.226414 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 1462) took 1408 ms. Trace:
I20260807 13:34:11.149327 10086 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:11.251608 10086 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:11.236533 5548 rpcz_store.cc:276] 0807 13:34:09.818209 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:09.852980 (+ 34771us) service_pool.cc:227] Handling call
0807 13:34:11.226231 (+1373251us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400398ad4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:11.226366 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":377193728}
W20260807 13:34:11.252126 10012 consensus_meta.cc:287] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.513s user 0.009s sys 0.001s
I20260807 13:34:11.252544 10012 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.255154 10386 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.257231 10386 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:11.261493 9985 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 11 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:11.215219 9933 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.262446 9933 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.264271 9933 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:11.221741 10432 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:11.269019 10432 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.230841 10397 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:11.271637 10432 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:11.204712 10093 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:11.203926 10406 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.276363 10093 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:11.277060 10406 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:11.276918 10102 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.279582 10102 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:11.243348 10431 log.cc:924] Time spent T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.064s user 0.000s sys 0.001s
I20260807 13:34:11.177171 10430 consensus_queue.cc:1046] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.094s
I20260807 13:34:11.231280 10454 consensus_queue.cc:1035] T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260807 13:34:11.221786 10403 consensus_queue.cc:1035] T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260807 13:34:11.298237 5770 raft_consensus.cc:1226] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:11.289701 10012 leader_election.cc:288] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:34:11.302796 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 71714.2us
W20260807 13:34:11.303789 10399 log.cc:924] Time spent T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.304s user 0.003s sys 0.000s
I20260807 13:34:11.304605 5722 leader_election.cc:302] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:34:11.310657 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 394683us
W20260807 13:34:11.310281 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 127180us
I20260807 13:34:11.313205 5618 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
W20260807 13:34:11.323581 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 108730us
I20260807 13:34:11.328902 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:11.312498 9985 consensus_queue.cc:1035] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260807 13:34:11.329785 6692 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 11.
I20260807 13:34:11.306030 9939 consensus_queue.cc:1035] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260807 13:34:11.329130 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:11.328649 10129 raft_consensus.cc:2726] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:11.328812 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:11.348089 10012 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:11.359521 10012 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:11.306093 10262 raft_consensus.cc:2726] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:11.348948 10437 consensus_queue.cc:1035] T f9a2a18897a34e30b068d5cbe66cc197 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 13:34:11.313122 10378 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.320613 10152 raft_consensus.cc:2726] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 13:34:11.220850 10446 raft_consensus.cc:504] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:11.363008 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 182520us
W20260807 13:34:11.496121 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 182998us
I20260807 13:34:11.573203 5618 leader_election.cc:302] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
W20260807 13:34:11.504256 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 180254us
I20260807 13:34:11.616369 5725 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:11.617421 10473 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 13:34:11.620806 5769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1838) took 1419 ms. Trace:
W20260807 13:34:11.442229 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 92318.5us
W20260807 13:34:11.469324 10410 log.cc:924] Time spent T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260807 13:34:11.621359 5769 rpcz_store.cc:276] 0807 13:34:10.191970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.193511 (+ 1541us) service_pool.cc:227] Handling call
0807 13:34:10.307105 (+113594us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:10.341714 (+ 34609us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:10.341745 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:10.341784 (+ 39us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:34:10.341812 (+ 28us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.611108 (+1269296us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b5400265f54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:11.611157 (+ 49us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:11.611285 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":79105920}
W20260807 13:34:11.622866 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 298076us
I20260807 13:34:11.617904 10473 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:11.372032 10012 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:11.628628 5722 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
W20260807 13:34:11.629853 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 56786.2us
I20260807 13:34:11.539346 10460 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:11.631253 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:11.633213 10102 raft_consensus.cc:482] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.634148 10474 raft_consensus.cc:2726] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:11.544014 9776 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:11.635452 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:11.636112 5667 raft_consensus.cc:2454] T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 6.
I20260807 13:34:11.636956 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:11.637625 5666 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:11.631214 10386 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.627964 10152 consensus_queue.cc:1046] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260807 13:34:11.621084 9933 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.638733 10386 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.639058 9933 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.641018 10386 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:11.641846 10152 raft_consensus.cc:3032] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:11.625037 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.634680 9899 consensus_queue.cc:1035] T fe27c759c1d64d15b7854094a751aa1a P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:34:11.646827 5722 leader_election.cc:302] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:11.642269 10152 raft_consensus.cc:729] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:11.654964 9776 raft_consensus.cc:2726] T ad0be1172a5341228befdfb4f3a40efd P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:11.655658 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.656946 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.657087 10152 consensus_queue.cc:260] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.658308 10152 raft_consensus.cc:3037] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:11.641045 9933 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:11.663239 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.380564 10403 consensus_queue.cc:1035] T 93d548887d4245c7b22072e49517a84f P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.252s
I20260807 13:34:11.634284 10093 raft_consensus.cc:2781] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:11.668650 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:11.653482 5764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32950 (request call id 1831) took 1851 ms (client timeout 1825 ms). Trace:
I20260807 13:34:11.670774 5618 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159
I20260807 13:34:11.672847 9776 consensus_queue.cc:1046] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 13:34:11.673794 9776 raft_consensus.cc:3032] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 10 LEADER]: Stepping down as leader of term 10
I20260807 13:34:11.674186 9776 raft_consensus.cc:729] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:11.626600 10378 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:11.675150 9776 consensus_queue.cc:260] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.682255 5501 leader_election.cc:302] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:11.676271 10430 consensus_queue.cc:1225] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer 0b9aca0aafaa43e7998ee8f3e59627e0 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260807 13:34:11.633839 10102 raft_consensus.cc:504] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.684010 10430 raft_consensus.cc:2726] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:11.684805 5501 leader_election.cc:302] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:11.678238 5499 leader_election.cc:302] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:11.678339 10406 raft_consensus.cc:482] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:11.678886 10396 raft_consensus.cc:482] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:11.678944 10419 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.546041 10379 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.679543 9917 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:11.627952 10473 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Advancing to term 12
I20260807 13:34:11.642132 10460 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:11.681380 10012 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.681808 10456 raft_consensus.cc:482] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:11.709698 9776 raft_consensus.cc:3037] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:11.685241 10102 leader_election.cc:288] T 1b3376f59e7e4a14ab419b67f1758cd9 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:11.722980 5501 leader_election.cc:302] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:11.708631 10262 raft_consensus.cc:2781] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 13:34:11.676630 10378 leader_election.cc:288] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
W20260807 13:34:11.669591 5764 rpcz_store.cc:269] 0807 13:34:09.779890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:09.780046 (+ 156us) service_pool.cc:227] Handling call
0807 13:34:11.630925 (+1850879us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54002c0e54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:11.631028 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1815027968}
I20260807 13:34:11.688755 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.695814 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.634084 10032 raft_consensus.cc:504] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.706760 5499 leader_election.cc:302] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:11.709438 10333 consensus_queue.cc:1046] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260807 13:34:11.712677 10370 log.cc:924] Time spent T 58893d6e4d174e17a32138854a565d6c P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 1.515s user 0.007s sys 0.015s
I20260807 13:34:11.712793 10379 leader_election.cc:288] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 6 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:11.713366 5761 raft_consensus.cc:1226] T 4a88f0c0fb0248fda509c04043a6ceb5 P 737c581af06a42df94970a1542600159 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 5. Current term is 6. Ops: []
I20260807 13:34:11.716805 10397 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.717888 10098 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:11.667973 10093 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.686295 10079 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.726042 5501 leader_election.cc:302] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:11.757148 5501 leader_election.cc:302] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:11.722864 10464 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.723398 10456 raft_consensus.cc:504] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.738453 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.741762 5770 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:11.741853 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94e7bc4ef4d34614b8ba037cb437058c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.767118 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.744294 5620 leader_election.cc:302] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf
I20260807 13:34:11.724900 10408 raft_consensus.cc:2726] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 13:34:11.747773 5499 leader_election.cc:302] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:11.724789 10430 raft_consensus.cc:2781] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Leader election won for term 11
W20260807 13:34:11.755427 5545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54404 (request call id 1459) took 1946 ms (client timeout 1513 ms). Trace:
W20260807 13:34:11.773113 5545 rpcz_store.cc:269] 0807 13:34:09.808624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:09.816575 (+ 7951us) service_pool.cc:227] Handling call
0807 13:34:11.755203 (+1938628us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54003354d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:11.755358 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1772741376}
I20260807 13:34:11.761039 5501 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:11.762769 5555 raft_consensus.cc:1261] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260807 13:34:11.708947 10406 raft_consensus.cc:504] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:11.764958 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.730794 10262 raft_consensus.cc:482] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.768191 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.769520 5763 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:11.774909 5499 leader_election.cc:302] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:11.777840 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de691af34db140198cfa9694fdc8ce3f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.726162 9917 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.754153 10093 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:11.785595 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a473fdcfed54f57b127f9f85d46c8ea" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:11.786345 10456 leader_election.cc:288] T 99f11806ff494d788e869d5368f88f3b P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:11.786270 10465 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:11.787561 10446 leader_election.cc:288] T 2f04480445ab4d6fa33d8835e8337f0c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:11.787734 10460 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:11.780185 10310 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:11.789366 6685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:11.790771 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:11.790885 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:11.718952 10419 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.776613 10438 raft_consensus.cc:2781] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 13:34:11.792315 10468 log.cc:924] Time spent T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260807 13:34:11.792243 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:11.843855 5662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1867) took 1713 ms. Trace:
I20260807 13:34:11.792835 10012 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:11.793006 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:11.794433 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54404 (request call id 1476) took 1505 ms. Trace:
I20260807 13:34:11.766784 10123 raft_consensus.cc:2726] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 13:34:11.762302 10432 raft_consensus.cc:2726] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 13:34:11.770224 10464 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.754959 10086 raft_consensus.cc:2726] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:11.710355 10396 raft_consensus.cc:504] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:11.804147 5660 raft_consensus.cc:1226] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260807 13:34:11.804633 10079 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:11.805182 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 60978.4us
I20260807 13:34:11.805680 9899 raft_consensus.cc:2781] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:11.807224 5656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1515) took 1461 ms. Trace:
I20260807 13:34:11.809428 5763 raft_consensus.cc:1226] T d5784def40b1487a966773a9c9a8d508 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:11.811757 10262 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:11.686425 10402 consensus_queue.cc:260] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:11.806193 10391 log.cc:924] Time spent T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159: Append to log took a long time: real 1.134s user 0.000s sys 0.016s
I20260807 13:34:11.822556 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:11.828477 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:11.830034 5771 raft_consensus.cc:1261] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Refusing update from remote peer 0b9aca0aafaa43e7998ee8f3e59627e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260807 13:34:11.782438 10408 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:11.844244 5662 rpcz_store.cc:276] 0807 13:34:10.130129 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.130266 (+ 137us) service_pool.cc:227] Handling call
0807 13:34:10.130588 (+ 322us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:10.529166 (+398578us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.843639 (+1314473us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54000ab254. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:11.843799 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":798888192}
I20260807 13:34:11.816020 10430 raft_consensus.cc:686] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 LEADER]: Becoming Leader. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
I20260807 13:34:11.865037 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:11.762357 10098 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:11.873704 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1563) took 1403 ms. Trace:
I20260807 13:34:11.915490 5554 rpcz_store.cc:276] 0807 13:34:10.469787 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.583040 (+113253us) service_pool.cc:227] Handling call
0807 13:34:10.583346 (+ 306us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:10.674549 (+ 91203us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:10.674577 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:10.676126 (+ 1549us) log.cc:842] Serialized 26 byte log entry
0807 13:34:11.351881 (+675755us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18002a5860. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff68200582c 00007ff67f4309dc 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44de22 00007ff681ff75bb 00007ff681ffd063 00007ff681ffd411
0807 13:34:11.352064 (+ 183us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:34:11.352435 (+ 371us) log.cc:842] Serialized 14 byte log entry
0807 13:34:11.685578 (+333143us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.873330 (+187752us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54001d47d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:11.873398 (+ 68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:11.873458 (+ 60us) raft_consensus.cc:1671] finished
0807 13:34:11.873476 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:11.873638 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":357081,"prepare.queue_time_us":2096,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":11455,"raft.queue_time_us":386395,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":5931,"spinlock_wait_cycles":221623552,"thread_start_us":63354,"threads_started":1,"wal-append.queue_time_us":181560}
I20260807 13:34:11.851037 5542 rpcz_store.cc:276] 0807 13:34:10.289503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.303831 (+ 14328us) service_pool.cc:227] Handling call
0807 13:34:10.345629 (+ 41798us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:11.288880 (+943251us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b18002db1a0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f41bf96 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff68071d301 00007ff6807378ba 00007ff68236f81d 00007ff682375f6b
0807 13:34:11.289057 (+ 177us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.289121 (+ 64us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:11.289628 (+ 507us) log.cc:842] Serialized 26 byte log entry
0807 13:34:11.494048 (+204420us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:34:11.610209 (+116161us) log.cc:842] Serialized 14 byte log entry
0807 13:34:11.681025 (+ 70816us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.681121 (+ 96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:11.794117 (+112996us) raft_consensus.cc:1671] finished
0807 13:34:11.794214 (+ 97us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:11.794364 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":74954,"prepare.queue_time_us":124866,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":138434,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":7022,"spinlock_wait_cycles":6815872,"thread_start_us":203958,"threads_started":1,"wal-append.queue_time_us":427717}
I20260807 13:34:11.843240 10456 raft_consensus.cc:2781] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:11.848672 10438 raft_consensus.cc:482] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:11.886488 5656 rpcz_store.cc:276] 0807 13:34:10.346264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.346395 (+ 131us) service_pool.cc:227] Handling call
0807 13:34:10.541707 (+195312us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:10.542207 (+ 500us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.806959 (+1264752us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54000cf650. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:11.807130 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":294714112}
I20260807 13:34:11.902355 5663 raft_consensus.cc:1261] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Refusing update from remote peer 737c581af06a42df94970a1542600159: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 13:34:11.838464 10465 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } attrs { replace: true } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:11.864903 10360 raft_consensus.cc:2726] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:11.909951 5620 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:11.912174 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:11.925209 5770 raft_consensus.cc:1226] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 10. Current term is 11. Ops: []
I20260807 13:34:11.934458 9829 raft_consensus.cc:3032] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 13:34:11.937676 10438 raft_consensus.cc:3037] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:11.940214 5543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1560) took 1470 ms. Trace:
I20260807 13:34:11.959179 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1567) took 1467 ms. Trace:
I20260807 13:34:11.941262 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:11.961057 5656 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
W20260807 13:34:11.950232 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 189295us
I20260807 13:34:11.950661 5660 raft_consensus.cc:2454] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:11.918684 9899 raft_consensus.cc:686] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:11.921164 10456 raft_consensus.cc:482] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:11.960182 5553 rpcz_store.cc:276] 0807 13:34:10.492214 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.199294 (+707080us) service_pool.cc:227] Handling call
0807 13:34:11.217875 (+ 18581us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:11.663582 (+445707us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.663610 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:11.670392 (+ 6782us) log.cc:842] Serialized 26 byte log entry
0807 13:34:11.696362 (+ 25970us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18001f8640. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f41bf96 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f430345 00007ff688267a39
0807 13:34:11.825078 (+128716us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:34:11.825115 (+ 37us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.825182 (+ 67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:11.946328 (+121146us) raft_consensus.cc:1671] finished
0807 13:34:11.946345 (+ 17us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:11.959110 (+ 12765us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":445311,"raft.queue_time_us":449740,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"spinlock_wait_cycles":37190528,"thread_start_us":128537,"threads_started":1,"wal-append.queue_time_us":268735}
I20260807 13:34:11.844338 10310 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:11.991137 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 81304.6us
I20260807 13:34:11.977644 5501 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0
W20260807 13:34:11.987345 5499 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 212495us
I20260807 13:34:12.005041 5501 leader_election.cc:302] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:11.910137 10455 consensus_queue.cc:1046] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.081s
I20260807 13:34:11.959637 5543 rpcz_store.cc:276] 0807 13:34:10.469324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.565216 (+ 95892us) service_pool.cc:227] Handling call
0807 13:34:10.565448 (+ 232us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:10.753011 (+187563us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:10.753054 (+ 43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:10.758311 (+ 5257us) log.cc:842] Serialized 26 byte log entry
0807 13:34:11.125358 (+367047us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:34:11.202313 (+ 76955us) log.cc:842] Serialized 14 byte log entry
0807 13:34:11.662779 (+460466us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b1800093ca0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f3c54ca 00007ff688aa6f99 00007ff67f289990 00007ff67f44b864 00007ff67f44b155 00007ff68236e3d0 00007ff682380576 00007ff6823910d7 00007ff682391058
0807 13:34:11.662928 (+ 149us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.662993 (+ 65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:11.936765 (+273772us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b1800093ca0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f41bf96 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11
0807 13:34:11.938197 (+ 1432us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b1800093ca0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff67f44e638 00007ff67f451b11 00007ff67f451ac9 00007ff67f451a59 00007ff67f451a21 00007ff67f450d1d 00007ff6886b2204 00007ff6886b2039 00007ff67f430dc6
0807 13:34:11.940007 (+ 1810us) raft_consensus.cc:1671] finished
0807 13:34:11.940030 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:11.940160 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8418,"prepare.queue_time_us":78176,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2332,"raft.queue_time_us":511123,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":8232,"spinlock_wait_cycles":26619904,"thread_start_us":510349,"threads_started":2,"wal-append.queue_time_us":436890}
I20260807 13:34:11.955521 10446 raft_consensus.cc:482] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:11.957440 9829 raft_consensus.cc:729] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:11.959159 10386 raft_consensus.cc:482] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:12.014343 5767 raft_consensus.cc:1226] T c61e1dd5b00c43d2a1747f4832ac333c P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260807 13:34:11.986490 10432 raft_consensus.cc:482] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:12.014076 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 58258.5us
I20260807 13:34:12.019526 5762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47820 (request call id 335) took 1674 ms. Trace:
I20260807 13:34:11.989796 10274 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:12.065729 10274 raft_consensus.cc:2726] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:12.066154 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:12.066365 10274 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:12.066815 6680 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 11.
I20260807 13:34:12.066864 10274 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.068822 5503 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
I20260807 13:34:12.069064 10274 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.069573 10274 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 13:34:11.998309 10456 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
W20260807 13:34:12.059371 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 60165.4us
I20260807 13:34:12.073410 5766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1834) took 1882 ms. Trace:
I20260807 13:34:12.004444 9827 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:12.004140 10032 leader_election.cc:288] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 11 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.069917 10274 raft_consensus.cc:482] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:12.012229 10397 leader_election.cc:288] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:12.006145 10408 raft_consensus.cc:482] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
W20260807 13:34:12.121598 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 51030.6us
I20260807 13:34:12.065480 5762 rpcz_store.cc:276] 0807 13:34:10.345405 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.345580 (+ 175us) service_pool.cc:227] Handling call
0807 13:34:10.412920 (+ 67340us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:10.434750 (+ 21830us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:10.434782 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:10.455010 (+ 20228us) log.cc:842] Serialized 26 byte log entry
0807 13:34:10.599844 (+144834us) raft_consensus.cc:1631] Marking committed up to 7
0807 13:34:10.599875 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:10.599934 (+ 59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:11.805815 (+1205881us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b24002383b8. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff67f292f11 00007ff67f2a6cf4 00007ff67f2a4dfb 00007ff67f333559 00007ff67f3331e5 00007ff67f33282d 00007ff681fe146e 00007ff681ff8c0c 00007ff681ff7f36 00007ff681ff7b58 00007ff682001551
0807 13:34:12.013710 (+207895us) raft_consensus.cc:1671] finished
0807 13:34:12.013736 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.019466 (+ 5730us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10234,"raft.queue_time_us":14109,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10680,"spinlock_wait_cycles":11944704,"thread_start_us":101400,"threads_started":1,"wal-append.queue_time_us":200062}
I20260807 13:34:12.019873 10490 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 13:34:12.120751 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 115797us
I20260807 13:34:12.079116 9827 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:12.115120 10096 raft_consensus.cc:2781] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:12.118736 10347 raft_consensus.cc:3032] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 13:34:12.154392 5656 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:12.116261 9917 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.123674 10274 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Advancing to term 12
W20260807 13:34:12.134538 10469 log.cc:924] Time spent T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.365s user 0.001s sys 0.001s
I20260807 13:34:12.173092 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:12.021469 10086 consensus_queue.cc:1035] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260807 13:34:12.166929 5545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1581) took 1500 ms. Trace:
I20260807 13:34:12.137645 10092 leader_election.cc:288] T a026eb38cd9747c89f7d1b5ba508dfe8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.132380 10406 leader_election.cc:288] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:12.147217 10490 raft_consensus.cc:482] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:12.079085 10432 raft_consensus.cc:504] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.022223 10446 raft_consensus.cc:504] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.129218 10386 raft_consensus.cc:504] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.079566 10430 consensus_queue.cc:237] T fe15514c51394171aa6a89ece7b59617 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:12.487138 6638 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 340135us
I20260807 13:34:12.221764 5765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32950 (request call id 1837) took 2030 ms. Trace:
W20260807 13:34:12.490890 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 94692.2us
W20260807 13:34:12.514861 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 355075us
I20260807 13:34:12.516179 5501 leader_election.cc:302] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:12.509032 5545 rpcz_store.cc:276] 0807 13:34:10.667179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.840550 (+1173371us) service_pool.cc:227] Handling call
0807 13:34:11.865827 (+ 25277us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:11.883572 (+ 17745us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.883601 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:11.902984 (+ 19383us) log.cc:842] Serialized 26 byte log entry
0807 13:34:12.020989 (+118005us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:34:12.128249 (+107260us) log.cc:842] Serialized 14 byte log entry
0807 13:34:12.128432 (+ 183us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.128525 (+ 93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:12.166569 (+ 38044us) raft_consensus.cc:1671] finished
0807 13:34:12.166591 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.166831 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":82915,"prepare.queue_time_us":107317,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":140112,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":59550,"thread_start_us":64013,"threads_started":1,"wal-append.queue_time_us":223922}
I20260807 13:34:12.518232 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:12.146750 10359 raft_consensus.cc:482] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.512915 5553 raft_consensus.cc:2932] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 737c581af06a42df94970a1542600159 (127.3.187.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } } }
W20260807 13:34:12.336531 10482 log.cc:924] Time spent T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.197s user 0.000s sys 0.000s
W20260807 13:34:12.596884 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 81882.3us
I20260807 13:34:12.511068 5765 rpcz_store.cc:276] 0807 13:34:10.191601 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.191752 (+ 151us) service_pool.cc:227] Handling call
0807 13:34:10.292631 (+100879us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:10.478845 (+186214us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:10.478886 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:10.501205 (+ 22319us) log.cc:842] Serialized 26 byte log entry
0807 13:34:10.651862 (+150657us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:34:10.651895 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.178875 (+1526980us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400036454. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:12.178928 (+ 53us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:12.178978 (+ 50us) raft_consensus.cc:1671] finished
0807 13:34:12.178996 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.221679 (+ 42683us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5858,"raft.queue_time_us":5995,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":21343,"spinlock_wait_cycles":376004864,"thread_start_us":129997,"threads_started":1,"wal-append.queue_time_us":178236,"wal-append.run_cpu_time_us":13500,"wal-append.run_wall_time_us":1591050}
W20260807 13:34:12.504159 10485 log.cc:924] Time spent T 99f11806ff494d788e869d5368f88f3b P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.499s user 0.001s sys 0.000s
I20260807 13:34:12.174403 9827 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Advancing to term 9
W20260807 13:34:12.320099 10473 consensus_meta.cc:287] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.598s user 0.009s sys 0.002s
W20260807 13:34:12.506815 10483 log.cc:924] Time spent T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.368s user 0.000s sys 0.001s
W20260807 13:34:12.519713 10093 consensus_meta.cc:287] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.702s user 0.006s sys 0.006s
I20260807 13:34:12.381919 10396 leader_election.cc:288] T c61e1dd5b00c43d2a1747f4832ac333c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:12.236600 10507 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.157058 10408 raft_consensus.cc:504] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.494712 10464 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.283007 10419 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.177855 10347 raft_consensus.cc:729] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:12.506199 10012 raft_consensus.cc:482] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.616858 10507 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.619586 10456 raft_consensus.cc:504] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.654578 5663 raft_consensus.cc:1261] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260807 13:34:12.655449 10404 log.cc:924] Time spent T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 1.757s user 0.009s sys 0.015s
I20260807 13:34:12.655740 10456 leader_election.cc:288] T e23c0bda4b9045029b855a13c38aadb7 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.620983 9846 consensus_queue.cc:1046] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 13:34:12.656533 9846 raft_consensus.cc:3032] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 13:34:12.656877 9846 raft_consensus.cc:729] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:12.650388 5542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 185) took 1555 ms. Trace:
I20260807 13:34:12.657693 9846 consensus_queue.cc:260] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.657286 5542 rpcz_store.cc:276] 0807 13:34:11.094928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.927281 (+832353us) service_pool.cc:227] Handling call
0807 13:34:11.961726 (+ 34445us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:11.989850 (+ 28124us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.989877 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:12.001057 (+ 11180us) log.cc:842] Serialized 26 byte log entry
0807 13:34:12.239380 (+238323us) raft_consensus.cc:1631] Marking committed up to 7
0807 13:34:12.239803 (+ 423us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.239884 (+ 81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:12.650189 (+410305us) raft_consensus.cc:1671] finished
0807 13:34:12.650213 (+ 24us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.650335 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19727,"raft.queue_time_us":28310,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6131,"thread_start_us":165299,"threads_started":1,"wal-append.queue_time_us":640962}
I20260807 13:34:12.659029 9846 raft_consensus.cc:3037] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 5 FOLLOWER]: Advancing to term 6
I20260807 13:34:12.659840 5548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1570) took 2145 ms. Trace:
I20260807 13:34:12.660106 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1566) took 2189 ms. Trace:
I20260807 13:34:12.660517 5544 rpcz_store.cc:276] 0807 13:34:10.474449 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.148769 (+674320us) service_pool.cc:227] Handling call
0807 13:34:11.181163 (+ 32394us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:11.200458 (+ 19295us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.200485 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:11.206121 (+ 5636us) log.cc:842] Serialized 26 byte log entry
0807 13:34:11.422381 (+216260us) raft_consensus.cc:1631] Marking committed up to 2
0807 13:34:11.422432 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.422526 (+ 94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:12.659929 (+1237403us) raft_consensus.cc:1671] finished
0807 13:34:12.659947 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.660057 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":448438,"raft.queue_time_us":1403,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6143,"thread_start_us":191237,"threads_started":1,"wal-append.queue_time_us":504274}
I20260807 13:34:12.660205 5548 rpcz_store.cc:276] 0807 13:34:10.514292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.252540 (+738248us) service_pool.cc:227] Handling call
0807 13:34:11.252883 (+ 343us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:11.671577 (+418694us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.671613 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:11.672063 (+ 450us) log.cc:842] Serialized 26 byte log entry
0807 13:34:11.829945 (+157882us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:34:11.829998 (+ 53us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.832663 (+ 2665us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:12.659635 (+826972us) raft_consensus.cc:1671] finished
0807 13:34:12.659656 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.659787 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":418344,"raft.queue_time_us":420658,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":157457,"threads_started":1,"wal-append.queue_time_us":332404}
I20260807 13:34:12.663605 5556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1568) took 2164 ms. Trace:
I20260807 13:34:12.623930 10512 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.626711 10333 consensus_queue.cc:1046] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 13:34:12.627373 10086 consensus_queue.cc:1035] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 13:34:12.235817 10184 consensus_queue.cc:1046] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.379s
I20260807 13:34:12.655579 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.631933 5555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1580) took 2007 ms. Trace:
W20260807 13:34:12.633858 10438 consensus_meta.cc:287] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.635s user 0.000s sys 0.005s
I20260807 13:34:12.634282 9985 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.178637 9829 consensus_queue.cc:260] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.635123 10310 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:12.637364 10098 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:12.638300 10093 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.639091 9933 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:12.579854 10388 consensus_queue.cc:1035] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.060s
I20260807 13:34:12.595721 10359 raft_consensus.cc:504] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.655639 10507 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.641135 10195 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:12.644434 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99f11806ff494d788e869d5368f88f3b" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.707268 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1250a61f1842c192fd95f3a267926f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:12.644811 10498 log.cc:924] Time spent T f9a2a18897a34e30b068d5cbe66cc197 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.219s user 0.001s sys 0.000s
I20260807 13:34:12.073724 5766 rpcz_store.cc:276] 0807 13:34:10.190594 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.190723 (+ 129us) service_pool.cc:227] Handling call
0807 13:34:10.295458 (+104735us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:10.295687 (+ 229us) raft_consensus.cc:1520] Early marking committed up to index 4
0807 13:34:11.842498 (+1546811us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b180026b2a0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6882ed8b1 00007ff6882fa661 00007ff68200582c 00007ff67f4309dc 00007ff688267a39 00007ff67f44d8bb 00007ff67f44bcbf 00007ff67f44b155 00007ff685d4b167 00007ff682380807 00007ff68238ff0f
0807 13:34:11.842633 (+ 135us) log.cc:842] Serialized 14 byte log entry
0807 13:34:12.073058 (+230425us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:12.073107 (+ 49us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:34:12.073152 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.073263 (+ 111us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.073368 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70261,"prepare.queue_time_us":172345,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":9380,"spinlock_wait_cycles":9326976,"thread_start_us":296757,"threads_started":2}
W20260807 13:34:12.645195 10481 log.cc:924] Time spent T 2c697ab25e4448969fc7491db2de779a P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.510s user 0.000s sys 0.001s
W20260807 13:34:12.645963 10499 log.cc:924] Time spent T 2c697ab25e4448969fc7491db2de779a P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.153s user 0.000s sys 0.000s
W20260807 13:34:12.646582 10487 log.cc:924] Time spent T 93d548887d4245c7b22072e49517a84f P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.426s user 0.001s sys 0.000s
I20260807 13:34:12.647064 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.649046 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.526289 10490 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:12.453094 10503 raft_consensus.cc:482] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.722980 10503 raft_consensus.cc:504] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.725116 10503 leader_election.cc:288] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.521221 10476 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
W20260807 13:34:12.627903 9776 consensus_meta.cc:287] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159: Time spent flushing consensus metadata: real 0.900s user 0.005s sys 0.004s
I20260807 13:34:12.664021 5556 rpcz_store.cc:276] 0807 13:34:10.499611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.226078 (+726467us) service_pool.cc:227] Handling call
0807 13:34:11.226362 (+ 284us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:11.628631 (+402269us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.628662 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:11.628715 (+ 53us) raft_consensus.cc:1631] Marking committed up to 5
0807 13:34:11.628750 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.663391 (+1034641us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400397bd4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:12.663442 (+ 51us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.663552 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":924722560}
I20260807 13:34:12.678931 5555 rpcz_store.cc:276] 0807 13:34:10.624470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.290866 (+666396us) service_pool.cc:227] Handling call
0807 13:34:11.755349 (+464483us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:11.774883 (+ 19534us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.631721 (+856838us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54003354d0. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:12.631863 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1041573248}
I20260807 13:34:12.699448 10388 consensus_queue.cc:1225] T 641931ccce1e4d71a725d4278f4306a1 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer 737c581af06a42df94970a1542600159 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260807 13:34:12.728500 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
W20260807 13:34:12.665928 10262 consensus_meta.cc:287] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.757s user 0.011s sys 0.000s
I20260807 13:34:12.692088 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:12.689642 9985 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.698199 10093 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.698763 9933 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:12.756155 10446 leader_election.cc:288] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.699419 10465 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:34:12.710702 5554 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s user 0.011s sys 0.030s
I20260807 13:34:12.756928 9985 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:12.711983 5659 raft_consensus.cc:1226] T 1040b0fd2a864acfbcba9c911244963f P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 8. Current term is 9. Ops: []
W20260807 13:34:12.757297 5554 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.584s user 0.011s sys 0.031s
I20260807 13:34:12.688642 10419 raft_consensus.cc:2726] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 13:34:12.711150 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.701236 10359 leader_election.cc:288] T 507708159cfa4a0885418e218939cd02 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.720222 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.716619 5662 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:12.687791 10456 consensus_queue.cc:1035] T 7750cee5180c40cd9177e29f5d41bce8 P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260807 13:34:12.686466 5501 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 170336us
I20260807 13:34:12.820838 5503 leader_election.cc:302] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:12.824374 5501 leader_election.cc:302] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:12.177603 9899 consensus_queue.cc:237] T 3855b3f3c6494a5491ce30bfc4b34d14 P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.820549 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.827270 5662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.616559 10473 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:12.743992 5666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.744786 5764 raft_consensus.cc:2396] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260807 13:34:12.746461 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1571) took 2228 ms. Trace:
I20260807 13:34:12.833145 5667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1524) took 1051 ms. Trace:
I20260807 13:34:12.746506 5663 raft_consensus.cc:3037] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:12.678737 10012 raft_consensus.cc:504] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.684067 10438 raft_consensus.cc:504] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.680712 10512 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:12.819077 5665 raft_consensus.cc:2454] T 1c7c63e776384e4191d85c1a670fcb60 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 7.
I20260807 13:34:12.829381 5501 leader_election.cc:302] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14f62bf285c448b9b7a21fabd7a5f0bf; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159
I20260807 13:34:12.757220 10432 leader_election.cc:288] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.802302 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 184) took 1885 ms. Trace:
I20260807 13:34:12.831557 5499 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:12.833377 5552 rpcz_store.cc:276] 0807 13:34:10.518146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.264012 (+745866us) service_pool.cc:227] Handling call
0807 13:34:11.264360 (+ 348us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:34:11.672696 (+408336us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.672729 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:34:11.673299 (+ 570us) log.cc:842] Serialized 52 byte log entry
0807 13:34:11.860202 (+186903us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:34:11.860286 (+ 84us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:11.860437 (+ 151us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:12.746177 (+885740us) raft_consensus.cc:1671] finished
0807 13:34:12.746205 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.746379 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":407952,"raft.queue_time_us":409408,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":171361,"threads_started":1,"wal-append.queue_time_us":334424}
W20260807 13:34:12.835719 5658 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.013s user 0.034s sys 0.070s
I20260807 13:34:12.835793 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:12.714987 10195 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.837430 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.833534 5667 rpcz_store.cc:276] 0807 13:34:11.781606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.781767 (+ 161us) service_pool.cc:227] Handling call
0807 13:34:11.825799 (+ 44032us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:11.841925 (+ 16126us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.841952 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:11.842450 (+ 498us) log.cc:842] Serialized 26 byte log entry
0807 13:34:12.001252 (+158802us) raft_consensus.cc:1631] Marking committed up to 3
0807 13:34:12.001291 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.001362 (+ 71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:12.832935 (+831573us) raft_consensus.cc:1671] finished
0807 13:34:12.832954 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.833073 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23604,"raft.queue_time_us":21308,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":19572,"thread_start_us":84812,"threads_started":1,"wal-append.queue_time_us":246936}
I20260807 13:34:12.756929 9933 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:12.834143 10359 raft_consensus.cc:2726] T de691af34db140198cfa9694fdc8ce3f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:12.751055 6693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37838 (request call id 199) took 1053 ms. Trace:
I20260807 13:34:12.801700 10503 raft_consensus.cc:482] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:12.841861 5662 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260807 13:34:12.819141 10360 raft_consensus.cc:482] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.822448 10093 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 13:34:12.846163 5658 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s user 0.035s sys 0.070s
W20260807 13:34:12.846283 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 245288us
I20260807 13:34:12.845079 5554 rpcz_store.cc:276] 0807 13:34:10.917112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.931254 (+1014142us) service_pool.cc:227] Handling call
0807 13:34:11.931616 (+ 362us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:11.955655 (+ 24039us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.955683 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:11.982051 (+ 26368us) log.cc:842] Serialized 26 byte log entry
0807 13:34:12.132623 (+150572us) raft_consensus.cc:1631] Marking committed up to 11
0807 13:34:12.757836 (+625213us) log.cc:842] Serialized 14 byte log entry
0807 13:34:12.801833 (+ 43997us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.801943 (+ 110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:12.802002 (+ 59us) raft_consensus.cc:1671] finished
0807 13:34:12.802020 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.802219 (+ 199us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":90225,"prepare.queue_time_us":48306,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3934,"raft.queue_time_us":91815,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":15427,"thread_start_us":696507,"threads_started":2,"wal-append.queue_time_us":630178}
I20260807 13:34:12.822068 10086 raft_consensus.cc:482] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.749688 10262 raft_consensus.cc:504] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.857120 6637 leader_election.cc:302] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters: 14f62bf285c448b9b7a21fabd7a5f0bf, 737c581af06a42df94970a1542600159
I20260807 13:34:12.838955 10446 raft_consensus.cc:2726] T 3a1250a61f1842c192fd95f3a267926f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:12.862425 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:12.865159 10432 raft_consensus.cc:2726] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 13:34:12.856598 10507 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:12.747921 10476 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.883220 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:12.875438 5658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52574 (request call id 1882) took 1251 ms. Trace:
I20260807 13:34:12.721675 10347 consensus_queue.cc:260] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.875159 5499 leader_election.cc:302] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 14f62bf285c448b9b7a21fabd7a5f0bf; no voters:
I20260807 13:34:12.866905 10386 leader_election.cc:288] T 83c1aab638794d7b89a5e2344158d7c0 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.880095 10503 raft_consensus.cc:504] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.895061 5661 raft_consensus.cc:1226] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:12.881848 10507 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:12.906248 5721 leader_election.cc:302] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters: d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:12.901855 10098 raft_consensus.cc:482] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:12.867527 6693 rpcz_store.cc:276] 0807 13:34:11.697806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.702352 (+ 4546us) service_pool.cc:227] Handling call
0807 13:34:11.702738 (+ 386us) raft_consensus.cc:1457] Updating replica for 2 ops
0807 13:34:11.703190 (+ 452us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:11.703223 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0807 13:34:11.703762 (+ 539us) log.cc:842] Serialized 52 byte log entry
0807 13:34:11.982325 (+278563us) raft_consensus.cc:1631] Marking committed up to 8
0807 13:34:11.990354 (+ 8029us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.001238 (+ 10884us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:12.725519 (+724281us) raft_consensus.cc:1671] finished
0807 13:34:12.725547 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.748512 (+ 22965us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1361,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3684,"thread_start_us":245786,"threads_started":1,"wal-append.queue_time_us":318673}
I20260807 13:34:12.911006 10098 raft_consensus.cc:504] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.913058 10098 leader_election.cc:288] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:12.913403 10406 raft_consensus.cc:482] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:12.903587 10347 raft_consensus.cc:3037] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:12.913837 10096 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.914355 10096 raft_consensus.cc:3037] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:12.913980 10406 raft_consensus.cc:504] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.916121 10406 leader_election.cc:288] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.916606 10406 raft_consensus.cc:482] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.917040 10406 raft_consensus.cc:504] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.918247 10396 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:12.918738 10396 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.920477 10396 leader_election.cc:288] T a7313c1813bc4e61a0c26ee5661f0a18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.920949 10396 raft_consensus.cc:482] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.921754 10456 raft_consensus.cc:482] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.926885 5721 leader_election.cc:302] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:12.877312 10093 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.899056 9776 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.880870 10360 raft_consensus.cc:504] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.907212 10446 raft_consensus.cc:2781] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 13:34:12.907541 10507 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:12.881173 10086 raft_consensus.cc:504] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.908679 10120 consensus_queue.cc:1035] T e23c0bda4b9045029b855a13c38aadb7 P 737c581af06a42df94970a1542600159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260807 13:34:12.925660 10454 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:12.950965 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.938305 10380 raft_consensus.cc:2781] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 13:34:12.943075 10102 raft_consensus.cc:3032] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:12.952549 10093 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.933126 10310 raft_consensus.cc:2781] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 13:34:12.955008 10096 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.956347 5771 raft_consensus.cc:1226] T d8088f9cbecf4cf59a35c5f15ba5490d P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 7. Current term is 8. Ops: []
I20260807 13:34:12.927493 10359 raft_consensus.cc:482] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.875891 10274 raft_consensus.cc:504] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:12.944561 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:12.961408 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7313c1813bc4e61a0c26ee5661f0a18" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:12.927686 10432 raft_consensus.cc:482] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:12.921324 10396 raft_consensus.cc:504] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.964928 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:12.977809 5762 raft_consensus.cc:3037] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:12.978703 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:12.925486 10456 raft_consensus.cc:504] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.980975 5766 raft_consensus.cc:1226] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 10. Current term is 11. Ops: []
I20260807 13:34:12.940662 10474 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:12.983270 5771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:12.942943 10446 raft_consensus.cc:482] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:12.962039 10529 raft_consensus.cc:482] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:12.961977 10515 raft_consensus.cc:482] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:13.046716 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:12.967957 10102 raft_consensus.cc:729] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:13.049479 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601f17ec93374792b153deacf070cc16" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.062880 5542 raft_consensus.cc:2454] T 601f17ec93374792b153deacf070cc16 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:13.063755 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865420f31e38417a929d1a0f5c2009ac" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:12.961922 10495 raft_consensus.cc:482] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:13.046519 5761 pending_rounds.cc:76] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 2
I20260807 13:34:13.051270 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.064760 5761 pending_rounds.cc:97] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260807 13:34:13.064996 5543 raft_consensus.cc:2454] T 92946d3f971149ddbb9f81496d989dde P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:13.065757 5554 raft_consensus.cc:2379] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in current term 7: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:13.066010 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.066987 5543 raft_consensus.cc:2379] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 12: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:12.944033 9776 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:12.971159 10517 raft_consensus.cc:2726] T 9a473fdcfed54f57b127f9f85d46c8ea P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 13:34:13.065052 5761 raft_consensus.cc:2866] T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:12.962010 10519 consensus_queue.cc:1046] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260807 13:34:13.073534 10495 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.078841 5659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1536) took 1287 ms. Trace:
I20260807 13:34:13.079216 5659 rpcz_store.cc:276] 0807 13:34:11.791688 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.910827 (+119139us) service_pool.cc:227] Handling call
0807 13:34:11.929326 (+ 18499us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:12.757631 (+828305us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:13.078611 (+320980us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54000ce254. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:13.078784 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1785973632}
I20260807 13:34:12.884775 5658 rpcz_store.cc:276] 0807 13:34:11.624103 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.624431 (+ 328us) service_pool.cc:227] Handling call
0807 13:34:11.624760 (+ 329us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:11.624967 (+ 207us) raft_consensus.cc:1520] Early marking committed up to index 6
0807 13:34:11.822525 (+197558us) log.cc:842] Serialized 14 byte log entry
0807 13:34:12.872055 (+1049530us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:12.872103 (+ 48us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:34:12.872146 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.872202 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:12.875387 (+ 3185us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":16119,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":1734,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6800,"thread_start_us":1230462,"threads_started":2}
I20260807 13:34:13.081375 10495 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.082367 10495 raft_consensus.cc:482] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:13.082541 5767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1770) took 2628 ms. Trace:
I20260807 13:34:13.082939 5767 rpcz_store.cc:276] 0807 13:34:10.454085 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:10.575674 (+121589us) service_pool.cc:227] Handling call
0807 13:34:12.014011 (+1438337us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:12.078303 (+ 64292us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:13.082341 (+1004038us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001f1650. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682375a09 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:13.082460 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3307169024}
I20260807 13:34:13.082957 10495 raft_consensus.cc:504] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:13.084529 10514 log.cc:924] Time spent T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.160s user 0.001s sys 0.000s
I20260807 13:34:13.085569 10495 leader_election.cc:288] T e7704ce89ae2457b9b1adf72a86591a4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.086228 10495 raft_consensus.cc:482] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:13.086371 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46432 (request call id 186) took 1782 ms. Trace:
I20260807 13:34:13.086809 5553 rpcz_store.cc:276] 0807 13:34:11.304393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.989295 (+684902us) service_pool.cc:227] Handling call
0807 13:34:12.013168 (+ 23873us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:12.013593 (+ 425us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:12.013628 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:12.131342 (+117714us) log.cc:842] Serialized 501 byte log entry
0807 13:34:12.512736 (+381394us) raft_consensus.cc:1631] Marking committed up to 7
0807 13:34:12.621889 (+109153us) log.cc:842] Serialized 14 byte log entry
0807 13:34:12.651075 (+ 29186us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:12.651196 (+ 121us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:13.086178 (+434982us) raft_consensus.cc:1671] finished
0807 13:34:13.086197 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:13.086318 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":830,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":346317,"threads_started":1,"wal-append.queue_time_us":699999}
I20260807 13:34:13.089066 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.086843 10495 raft_consensus.cc:504] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.092530 10495 leader_election.cc:288] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:12.963176 10330 consensus_queue.cc:1035] T 0ae537112be24f77ab71856bb03006ce P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260807 13:34:12.972589 10310 raft_consensus.cc:482] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:13.094467 10310 raft_consensus.cc:3037] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:13.090258 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:13.095335 6692 raft_consensus.cc:3037] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 11 FOLLOWER]: Advancing to term 12
I20260807 13:34:13.096377 10086 leader_election.cc:288] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.097077 10406 leader_election.cc:288] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.098894 10096 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:13.105091 10396 leader_election.cc:288] T ad0be1172a5341228befdfb4f3a40efd P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.058008 10446 raft_consensus.cc:3037] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:13.108958 10503 leader_election.cc:288] T 0ae537112be24f77ab71856bb03006ce P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.056456 10438 leader_election.cc:288] T f9a2a18897a34e30b068d5cbe66cc197 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.111729 10262 leader_election.cc:288] T 34cf6d5926a945c3bcae21611f9b8dbe P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 7 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.054272 10380 raft_consensus.cc:686] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:13.113205 10380 consensus_queue.cc:237] T 9417f147a78e41728d00594b19828f18 P 737c581af06a42df94970a1542600159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.046243 10473 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 12 election: Requested vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:13.070397 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.071699 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5784def40b1487a966773a9c9a8d508" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:13.073560 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c1aab638794d7b89a5e2344158d7c0" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.075243 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.090247 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:13.090339 10456 leader_election.cc:288] T abe57eac6430478584bb4e98bfff100f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.067160 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0724fe2430d41e588c520b9a8228cb4" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.125317 5544 raft_consensus.cc:2454] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:13.125705 5764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1779) took 1391 ms. Trace:
I20260807 13:34:13.122915 5553 raft_consensus.cc:3037] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:13.122874 5545 raft_consensus.cc:2454] T 35f1738bc8ae4372b7379be9ce23052e P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:13.122681 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b3376f59e7e4a14ab419b67f1758cd9" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
W20260807 13:34:13.070042 5721 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 107653us
I20260807 13:34:13.127588 5554 raft_consensus.cc:2454] T 1b3376f59e7e4a14ab419b67f1758cd9 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:13.126245 5764 rpcz_store.cc:276] 0807 13:34:11.734558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:11.790571 (+ 56013us) service_pool.cc:227] Handling call
0807 13:34:13.125512 (+1334941us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b5400211954. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:13.125644 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2073575680}
I20260807 13:34:13.128546 5554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1040b0fd2a864acfbcba9c911244963f" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:13.121984 5548 raft_consensus.cc:2454] T 2b0808d0c45840eb9b05a49a18515c90 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 8.
I20260807 13:34:13.130014 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:13.130678 5545 raft_consensus.cc:3037] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Advancing to term 11
I20260807 13:34:13.122496 5542 raft_consensus.cc:2454] T 83c1aab638794d7b89a5e2344158d7c0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 5.
I20260807 13:34:12.973860 10359 raft_consensus.cc:504] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.132542 5542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:12.986569 10432 raft_consensus.cc:504] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.081908 10360 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.145475 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e73dd10d6fc4b29b9371e6df66c3ed0" candidate_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.151626 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe27c759c1d64d15b7854094a751aa1a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.151770 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:13.152403 5544 raft_consensus.cc:2454] T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:13.152577 5543 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:13.072803 10012 leader_election.cc:288] T 37b9562e68354bc69b54b07a09406578 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:34:13.161442 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 221992us
I20260807 13:34:13.161649 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.162814 5548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c697ab25e4448969fc7491db2de779a" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:12.972776 10454 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.166944 5767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.121892 10195 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.172957 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.173545 5658 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:13.175282 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.219847 10539 raft_consensus.cc:482] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:13.220839 10539 raft_consensus.cc:504] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.220137 6680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:13.049136 10474 raft_consensus.cc:504] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.222859 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.224574 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.222465 5548 raft_consensus.cc:2454] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:13.225714 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.226624 5764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34cf6d5926a945c3bcae21611f9b8dbe" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:13.239521 5661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52582 (request call id 1543) took 1223 ms. Trace:
I20260807 13:34:13.240005 5661 rpcz_store.cc:276] 0807 13:34:12.015659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:12.015810 (+ 151us) service_pool.cc:227] Handling call
0807 13:34:12.070614 (+ 54804us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:12.897438 (+826824us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:13.239236 (+341798us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b540026d9d4. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:13.239451 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1895620864}
I20260807 13:34:13.219945 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.155773 10512 leader_election.cc:288] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P d6b8ccce5b91423b8673ddfbbf2c1b1c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:13.243559 5658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.239246 5769 raft_consensus.cc:2454] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
I20260807 13:34:13.245792 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9a2a18897a34e30b068d5cbe66cc197" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:13.246125 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.253348 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7704ce89ae2457b9b1adf72a86591a4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.247352 5545 raft_consensus.cc:2454] T 99c4182493ae4faa8085c4f332f8c07d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 11.
I20260807 13:34:13.246320 5656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3566608e8e74f10a291207e9cb298b8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.254992 5553 raft_consensus.cc:2454] T 34cf6d5926a945c3bcae21611f9b8dbe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 7.
I20260807 13:34:13.260566 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.262601 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abe57eac6430478584bb4e98bfff100f" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.226496 10274 leader_election.cc:288] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 12 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:13.262866 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f1738bc8ae4372b7379be9ce23052e" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.265494 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58893d6e4d174e17a32138854a565d6c" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0"
I20260807 13:34:13.268043 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a88f0c0fb0248fda509c04043a6ceb5" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:13.268160 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.270051 5545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9417f147a78e41728d00594b19828f18" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:13.278255 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0be1172a5341228befdfb4f3a40efd" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.281831 5663 raft_consensus.cc:2454] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 10.
I20260807 13:34:13.063987 10529 raft_consensus.cc:504] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
W20260807 13:34:13.256233 5722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.187.193:39143 timed out after 1.558s (SENT) [suppressed 13 similar messages]
I20260807 13:34:13.068966 10515 raft_consensus.cc:504] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.285883 5658 raft_consensus.cc:1226] T e23c0bda4b9045029b855a13c38aadb7 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 FOLLOWER]: Rejecting Update request from peer 737c581af06a42df94970a1542600159 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260807 13:34:13.236039 9899 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:13.246031 10237 raft_consensus.cc:482] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:13.287861 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ae537112be24f77ab71856bb03006ce" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.251224 10465 raft_consensus.cc:482] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 14f62bf285c448b9b7a21fabd7a5f0bf)
I20260807 13:34:13.259753 10476 leader_election.cc:288] T b950598d88564a8a85e1489e7f9843cb P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:13.302225 5554 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:13.181389 10102 consensus_queue.cc:260] T d5784def40b1487a966773a9c9a8d508 P 0b9aca0aafaa43e7998ee8f3e59627e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.317530 5767 raft_consensus.cc:2396] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9aca0aafaa43e7998ee8f3e59627e0 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260807 13:34:13.354768 5554 raft_consensus.cc:2454] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 9.
W20260807 13:34:13.361727 5722 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 105510us
I20260807 13:34:13.245285 10543 consensus_queue.cc:1046] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.097s
W20260807 13:34:13.372032 5618 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.193:39143, user_credentials={real_user=slave}} blocked reactor thread for 105139us
I20260807 13:34:13.383955 10360 raft_consensus.cc:482] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:13.384536 10360 raft_consensus.cc:504] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.300609 10465 raft_consensus.cc:504] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.297606 10237 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.403574 10465 leader_election.cc:288] T 5aa7518c16b1482b87aa72990193cafd P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:13.406270 10359 leader_election.cc:288] T e25f5d92529949cb904fde2d44bd715a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.298039 9899 raft_consensus.cc:504] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.434823 9899 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.382972 9776 leader_election.cc:288] T 5d8130b8a41d445a89847207cfa96bfe P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:13.554582 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.555048 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f04480445ab4d6fa33d8835e8337f0c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.539956 5543 raft_consensus.cc:2454] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:13.571045 5544 raft_consensus.cc:1226] T b3566608e8e74f10a291207e9cb298b8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Rejecting Update request from peer 0b9aca0aafaa43e7998ee8f3e59627e0 for earlier term 6. Current term is 7. Ops: []
I20260807 13:34:13.448086 5762 raft_consensus.cc:2454] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in term 11.
I20260807 13:34:13.571858 5765 raft_consensus.cc:2379] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 12: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
W20260807 13:34:13.572613 5725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.196:41077, user_credentials={real_user=slave}} blocked reactor thread for 253448us
I20260807 13:34:13.572942 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7c63e776384e4191d85c1a670fcb60" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.545083 9829 raft_consensus.cc:3037] T b3566608e8e74f10a291207e9cb298b8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Advancing to term 7
I20260807 13:34:13.575938 10419 raft_consensus.cc:482] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:13.576509 10419 raft_consensus.cc:504] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:13.578332 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a026eb38cd9747c89f7d1b5ba508dfe8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:13.466053 9827 consensus_meta.cc:287] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.816s user 0.006s sys 0.000s
I20260807 13:34:13.578645 10419 leader_election.cc:288] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:13.470646 10432 leader_election.cc:288] T 2c697ab25e4448969fc7491db2de779a P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.576890 5770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:13.424554 10347 consensus_meta.cc:287] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0: Time spent flushing consensus metadata: real 0.510s user 0.009s sys 0.000s
I20260807 13:34:13.433003 10529 leader_election.cc:288] T fe15514c51394171aa6a89ece7b59617 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:13.588171 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:13.589304 10408 leader_election.cc:288] T e0724fe2430d41e588c520b9a8228cb4 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.642850 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0808d0c45840eb9b05a49a18515c90" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.644022 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.592535 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6f41d0f11d4c6295bae40c23631a4a" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.590492 5769 raft_consensus.cc:1261] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Refusing update from remote peer 14f62bf285c448b9b7a21fabd7a5f0bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260807 13:34:13.590900 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e23c0bda4b9045029b855a13c38aadb7" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159"
I20260807 13:34:13.646128 5769 pending_rounds.cc:76] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Aborting all ops after (but not including) 3
W20260807 13:34:13.542672 10557 log.cc:924] Time spent T 641931ccce1e4d71a725d4278f4306a1 P 737c581af06a42df94970a1542600159: Append to log took a long time: real 0.176s user 0.000s sys 0.000s
I20260807 13:34:13.636013 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.646637 5769 pending_rounds.cc:97] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260807 13:34:13.647017 5769 raft_consensus.cc:2866] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 13:34:13.647235 5762 raft_consensus.cc:2379] T 3855b3f3c6494a5491ce30bfc4b34d14 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 8: Already voted for candidate 0b9aca0aafaa43e7998ee8f3e59627e0 in this term.
W20260807 13:34:13.470371 10541 log.cc:924] Time spent T c61e1dd5b00c43d2a1747f4832ac333c P d6b8ccce5b91423b8673ddfbbf2c1b1c: Append to log took a long time: real 0.328s user 0.000s sys 0.001s
I20260807 13:34:13.463424 10237 leader_election.cc:288] T e1f11d721d314b9897773816faaa3205 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
W20260807 13:34:13.543496 10490 consensus_meta.cc:287] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf: Time spent flushing consensus metadata: real 0.821s user 0.009s sys 0.000s
W20260807 13:34:13.641839 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 60756.1us
I20260807 13:34:13.590487 5770 raft_consensus.cc:2454] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in term 9.
I20260807 13:34:13.432493 10539 leader_election.cc:288] T 58893d6e4d174e17a32138854a565d6c P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.564949 9899 raft_consensus.cc:482] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:13.672884 5770 raft_consensus.cc:1226] T 865420f31e38417a929d1a0f5c2009ac P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Rejecting Update request from peer 14f62bf285c448b9b7a21fabd7a5f0bf for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260807 13:34:13.646049 5543 raft_consensus.cc:1799] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Handling vote request from an unknown peer 737c581af06a42df94970a1542600159
I20260807 13:34:13.542888 10474 leader_election.cc:288] T 9675aa173f334c5f870358069a6e68f4 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569)
I20260807 13:34:13.549780 10310 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:13.465241 6692 raft_consensus.cc:2454] T 41befa481a284977a33f2f54ba55af62 P d6b8ccce5b91423b8673ddfbbf2c1b1c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 12.
I20260807 13:34:13.438786 10454 leader_election.cc:288] T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 14f62bf285c448b9b7a21fabd7a5f0bf (127.3.187.193:39143), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.664055 5769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61e1dd5b00c43d2a1747f4832ac333c" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.511710 9917 raft_consensus.cc:482] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d6b8ccce5b91423b8673ddfbbf2c1b1c)
I20260807 13:34:13.709508 5663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.669133 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c4182493ae4faa8085c4f332f8c07d" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.710740 5762 raft_consensus.cc:2379] T 99c4182493ae4faa8085c4f332f8c07d P 737c581af06a42df94970a1542600159 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14f62bf285c448b9b7a21fabd7a5f0bf in current term 11: Already voted for candidate 737c581af06a42df94970a1542600159 in this term.
I20260807 13:34:13.438658 10446 raft_consensus.cc:504] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.579981 10549 raft_consensus.cc:482] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:13.668790 5765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "507708159cfa4a0885418e218939cd02" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
I20260807 13:34:13.645287 5763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92946d3f971149ddbb9f81496d989dde" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "737c581af06a42df94970a1542600159" is_pre_election: true
W20260807 13:34:13.642019 10380 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s user 0.006s sys 0.015s
I20260807 13:34:13.678300 5543 raft_consensus.cc:2396] T fc6f41d0f11d4c6295bae40c23631a4a P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260807 13:34:13.437050 10507 raft_consensus.cc:504] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.712093 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9675aa173f334c5f870358069a6e68f4" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.716637 5667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d8130b8a41d445a89847207cfa96bfe" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:13.648955 10437 raft_consensus.cc:3032] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 13:34:13.689706 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8088f9cbecf4cf59a35c5f15ba5490d" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:13.668752 10532 raft_consensus.cc:482] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:13.738529 5766 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:13.752839 5725 leader_election.cc:302] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 737c581af06a42df94970a1542600159, d6b8ccce5b91423b8673ddfbbf2c1b1c; no voters:
W20260807 13:34:13.716305 10380 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s user 0.006s sys 0.015s
I20260807 13:34:13.614410 9827 raft_consensus.cc:504] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:13.768193 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc56ae27721c4c918c12ed9b14dc2950" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.774978 5543 raft_consensus.cc:2454] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 10.
I20260807 13:34:13.775539 5721 leader_election.cc:302] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:13.780193 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9bb2629a0e741fbb67f5b64ab12e4d8" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.781706 5721 leader_election.cc:302] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 737c581af06a42df94970a1542600159; no voters: 0b9aca0aafaa43e7998ee8f3e59627e0, d6b8ccce5b91423b8673ddfbbf2c1b1c
I20260807 13:34:13.796700 5544 raft_consensus.cc:2379] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 10: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:13.691704 10360 leader_election.cc:288] T fc56ae27721c4c918c12ed9b14dc2950 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:13.734926 10437 raft_consensus.cc:729] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:13.748588 10539 raft_consensus.cc:482] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:13.689812 9899 raft_consensus.cc:504] T a7313c1813bc4e61a0c26ee5661f0a18 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.820849 5666 raft_consensus.cc:1226] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Rejecting Update request from peer d6b8ccce5b91423b8673ddfbbf2c1b1c for earlier term 8. Current term is 9. Ops: []
I20260807 13:34:13.714728 9917 raft_consensus.cc:504] T 03cc5aef20f549689e8b1ba7db0effed P 14f62bf285c448b9b7a21fabd7a5f0bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:13.670652 10490 raft_consensus.cc:504] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.806752 10476 raft_consensus.cc:2781] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:13.816618 10535 raft_consensus.cc:2781] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 12 FOLLOWER]: Leader election won for term 12
I20260807 13:34:13.766988 10093 consensus_queue.cc:1046] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260807 13:34:14.023943 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 274447us
I20260807 13:34:13.892186 5660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa7518c16b1482b87aa72990193cafd" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:14.095629 5543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3855b3f3c6494a5491ce30bfc4b34d14" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:13.893105 5665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1f11d721d314b9897773816faaa3205" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:14.046748 5545 raft_consensus.cc:3037] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Advancing to term 8
I20260807 13:34:14.100800 5665 raft_consensus.cc:2454] T e1f11d721d314b9897773816faaa3205 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 9.
I20260807 13:34:13.832818 10529 raft_consensus.cc:2726] T fc6f41d0f11d4c6295bae40c23631a4a P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 13:34:13.895577 5661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe15514c51394171aa6a89ece7b59617" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" is_pre_election: true
I20260807 13:34:14.094945 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1595) took 1043 ms. Trace:
I20260807 13:34:13.838593 10360 raft_consensus.cc:482] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:13.872872 10544 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:14.103089 5661 raft_consensus.cc:2454] T fe15514c51394171aa6a89ece7b59617 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 11.
I20260807 13:34:14.103035 5553 rpcz_store.cc:276] 0807 13:34:13.051976 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:13.255810 (+203834us) service_pool.cc:227] Handling call
0807 13:34:13.256135 (+ 325us) raft_consensus.cc:1457] Updating replica for 1 ops
0807 13:34:13.269216 (+ 13081us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:13.269243 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0807 13:34:13.278579 (+ 9336us) log.cc:842] Serialized 26 byte log entry
0807 13:34:13.644877 (+366298us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:34:13.645293 (+ 416us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:13.645387 (+ 94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0807 13:34:13.921679 (+276292us) raft_consensus.cc:1671] finished
0807 13:34:13.921707 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:14.094869 (+173162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12706,"raft.queue_time_us":14652,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15725,"thread_start_us":339689,"threads_started":1,"wal-append.queue_time_us":623878}
W20260807 13:34:13.891546 10558 log.cc:924] Time spent T 9675aa173f334c5f870358069a6e68f4 P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.117s user 0.000s sys 0.000s
I20260807 13:34:14.119520 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b950598d88564a8a85e1489e7f9843cb" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:14.120121 5553 raft_consensus.cc:2454] T b950598d88564a8a85e1489e7f9843cb P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:14.069231 10456 raft_consensus.cc:482] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:14.113935 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5ae9ad6f573417ea9bbab82087da0d6" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:14.123435 5544 raft_consensus.cc:2454] T e5ae9ad6f573417ea9bbab82087da0d6 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:13.873507 10476 raft_consensus.cc:482] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 13:34:13.889963 10129 raft_consensus.cc:3032] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260807 13:34:14.096504 5543 raft_consensus.cc:2454] T 3855b3f3c6494a5491ce30bfc4b34d14 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 7.
I20260807 13:34:13.915758 10408 raft_consensus.cc:482] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:13.945366 10432 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9aca0aafaa43e7998ee8f3e59627e0)
I20260807 13:34:13.914525 10506 raft_consensus.cc:3032] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 LEADER]: Stepping down as leader of term 10
I20260807 13:34:14.103663 10184 raft_consensus.cc:482] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:14.126716 5544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9562e68354bc69b54b07a09406578" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" is_pre_election: true
I20260807 13:34:14.023972 10419 raft_consensus.cc:482] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 737c581af06a42df94970a1542600159)
I20260807 13:34:14.091337 10515 leader_election.cc:288] T 1040b0fd2a864acfbcba9c911244963f P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:14.129468 5553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41befa481a284977a33f2f54ba55af62" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf"
I20260807 13:34:14.114241 10310 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 737c581af06a42df94970a1542600159 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:14.134491 5544 raft_consensus.cc:2454] T 37b9562e68354bc69b54b07a09406578 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:13.872213 10539 raft_consensus.cc:504] T 8e73dd10d6fc4b29b9371e6df66c3ed0 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:14.119441 10402 raft_consensus.cc:3037] T 641931ccce1e4d71a725d4278f4306a1 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:14.123809 10535 raft_consensus.cc:686] T 41befa481a284977a33f2f54ba55af62 P 737c581af06a42df94970a1542600159 [term 12 LEADER]: Becoming Leader. State: Replica: 737c581af06a42df94970a1542600159, State: Running, Role: LEADER
I20260807 13:34:14.127876 10356 raft_consensus.cc:482] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 13:34:14.122607 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "737c581af06a42df94970a1542600159" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:14.127017 10446 leader_election.cc:288] T 1c7c63e776384e4191d85c1a670fcb60 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 8 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:14.129679 10476 raft_consensus.cc:3037] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 737c581af06a42df94970a1542600159 [term 9 FOLLOWER]: Advancing to term 10
I20260807 13:34:14.150509 5545 raft_consensus.cc:2454] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737c581af06a42df94970a1542600159 in term 8.
I20260807 13:34:14.128008 10129 raft_consensus.cc:729] T 99c4182493ae4faa8085c4f332f8c07d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b9aca0aafaa43e7998ee8f3e59627e0, State: Running, Role: LEADER
I20260807 13:34:14.136533 5620 leader_election.cc:302] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9aca0aafaa43e7998ee8f3e59627e0, 737c581af06a42df94970a1542600159; no voters:
I20260807 13:34:14.155184 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3bf6b4114cb4a07b86da2385fa903bc" candidate_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c"
I20260807 13:34:14.160648 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54390 (request call id 1608) took 1104 ms. Trace:
I20260807 13:34:14.128721 10507 leader_election.cc:288] T f9bb2629a0e741fbb67f5b64ab12e4d8 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 10 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:14.164039 5553 raft_consensus.cc:2379] T 41befa481a284977a33f2f54ba55af62 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 737c581af06a42df94970a1542600159 in current term 12: Already voted for candidate 14f62bf285c448b9b7a21fabd7a5f0bf in this term.
I20260807 13:34:14.090797 10437 consensus_queue.cc:260] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:14.118898 10360 raft_consensus.cc:504] T d5784def40b1487a966773a9c9a8d508 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:14.133724 10506 raft_consensus.cc:729] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 14f62bf285c448b9b7a21fabd7a5f0bf, State: Running, Role: LEADER
W20260807 13:34:14.171555 10556 log.cc:924] Time spent T fe27c759c1d64d15b7854094a751aa1a P 14f62bf285c448b9b7a21fabd7a5f0bf: Append to log took a long time: real 0.350s user 0.003s sys 0.000s
I20260807 13:34:14.174451 5666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48804 (request call id 343) took 1493 ms. Trace:
I20260807 13:34:13.728377 10549 raft_consensus.cc:504] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
I20260807 13:34:14.197667 10549 leader_election.cc:288] T 5f4a8b1973984ea99cbc92ff5ba63770 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
I20260807 13:34:14.145131 10380 consensus_queue.cc:1046] T 34cf6d5926a945c3bcae21611f9b8dbe P 737c581af06a42df94970a1542600159 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260807 13:34:14.142539 9827 leader_election.cc:288] T f3bf6b4114cb4a07b86da2385fa903bc P 0b9aca0aafaa43e7998ee8f3e59627e0 [CANDIDATE]: Term 9 election: Requested vote from peers 737c581af06a42df94970a1542600159 (127.3.187.195:43427), d6b8ccce5b91423b8673ddfbbf2c1b1c (127.3.187.196:41077)
W20260807 13:34:14.183471 6636 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.187.194:42569, user_credentials={real_user=slave}} blocked reactor thread for 45973.5us
I20260807 13:34:14.199744 6693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f4a8b1973984ea99cbc92ff5ba63770" candidate_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" is_pre_election: true
I20260807 13:34:14.183761 5554 rpcz_store.cc:276] 0807 13:34:13.055835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:13.128335 (+ 72500us) service_pool.cc:227] Handling call
0807 13:34:14.160474 (+1032139us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002e6b54. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff68237a2ae 00007ff6872b7c27 00007ff68099fc04 00007ff68099fb92 00007ff68099fac1 00007ff68099fa3c 00007ff68099ecf2 00007ff6807a094c 00007ff68079fd86 00007ff68079f72f
0807 13:34:14.160576 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":397890304}
I20260807 13:34:14.135490 10432 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 14f62bf285c448b9b7a21fabd7a5f0bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:13.770296 10532 raft_consensus.cc:504] T 7750cee5180c40cd9177e29f5d41bce8 P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:14.164867 5544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1598) took 1112 ms. Trace:
I20260807 13:34:14.142422 10419 raft_consensus.cc:504] T 9a473fdcfed54f57b127f9f85d46c8ea P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } } peers { permanent_uuid: "d6b8ccce5b91423b8673ddfbbf2c1b1c" member_type: VOTER last_known_addr { host: "127.3.187.196" port: 41077 } attrs { promote: false } }
W20260807 13:34:14.191164 5620 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.187.195:43427, user_credentials={real_user=slave}} blocked reactor thread for 54706.8us
I20260807 13:34:14.191780 5666 rpcz_store.cc:276] 0807 13:34:12.681343 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:12.839921 (+158578us) service_pool.cc:227] Handling call
0807 13:34:12.840233 (+ 312us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:13.845676 (+1005443us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:14.174178 (+328502us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54002d1254. stack: 00007ff67f41c033 00007ff67f41bf30 00007ff67ed7a534 00007ff688a868b4 00007ff688a86849 00007ff6822fb471 00007ff682376f51 00007ff68237599e 00007ff6872b72e9 00007ff68099d684 00007ff68099d612 00007ff68099d541 00007ff68099d4bc 00007ff68099c772 00007ff6807a094c 00007ff68079fd86
0807 13:34:14.174381 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2247866240}
W20260807 13:34:14.194356 10566 log.cc:924] Time spent T 7750cee5180c40cd9177e29f5d41bce8 P 0b9aca0aafaa43e7998ee8f3e59627e0: Append to log took a long time: real 0.267s user 0.001s sys 0.000s
I20260807 13:34:14.129130 10456 raft_consensus.cc:504] T 94e7bc4ef4d34614b8ba037cb437058c P 14f62bf285c448b9b7a21fabd7a5f0bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:14.139138 10184 raft_consensus.cc:504] T 4a88f0c0fb0248fda509c04043a6ceb5 P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:14.202520 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1600) took 1149 ms. Trace:
I20260807 13:34:14.223578 5554 rpcz_store.cc:276] 0807 13:34:13.053436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:14.201798 (+1148362us) service_pool.cc:227] Handling call
0807 13:34:14.201989 (+ 191us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:14.202226 (+ 237us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:14.202243 (+ 17us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:14.202303 (+ 60us) raft_consensus.cc:1631] Marking committed up to 8
0807 13:34:14.202332 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:14.202388 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:14.202480 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:34:14.135020 10408 raft_consensus.cc:504] T 5d8130b8a41d445a89847207cfa96bfe P 14f62bf285c448b9b7a21fabd7a5f0bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:14.206408 5544 rpcz_store.cc:276] 0807 13:34:13.052860 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:14.144217 (+1091357us) service_pool.cc:227] Handling call
0807 13:34:14.164446 (+ 20229us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:14.164595 (+ 149us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:14.164616 (+ 21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:14.164661 (+ 45us) raft_consensus.cc:1631] Marking committed up to 4
0807 13:34:14.164687 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:14.164731 (+ 44us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:14.164818 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:34:14.185840 5553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1599) took 1132 ms. Trace:
I20260807 13:34:14.117153 10544 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 14f62bf285c448b9b7a21fabd7a5f0bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:14.226145 5554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1601) took 1172 ms. Trace:
I20260807 13:34:14.203960 10437 raft_consensus.cc:3037] T 1040b0fd2a864acfbcba9c911244963f P 737c581af06a42df94970a1542600159 [term 8 FOLLOWER]: Advancing to term 9
I20260807 13:34:14.178133 10356 raft_consensus.cc:504] T d8088f9cbecf4cf59a35c5f15ba5490d P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195" port: 43427 } }
I20260807 13:34:14.223763 5552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54390 (request call id 1584) took 1176 ms. Trace:
I20260807 13:34:14.227455 5553 rpcz_store.cc:276] 0807 13:34:13.053147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0807 13:34:14.184458 (+1131311us) service_pool.cc:227] Handling call
0807 13:34:14.184707 (+ 249us) raft_consensus.cc:1457] Updating replica for 0 ops
0807 13:34:14.184866 (+ 159us) raft_consensus.cc:1520] Early marking committed up to index 0
0807 13:34:14.185246 (+ 380us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0807 13:34:14.185298 (+ 52us) raft_consensus.cc:1631] Marking committed up to 6
0807 13:34:14.185348 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0807 13:34:14.185683 (+ 335us) raft_consensus.cc:1677] UpdateReplicas() finished
0807 13:34:14.185792 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260807 13:34:14.203711 10388 raft_consensus.cc:2781] T 5aa7518c16b1482b87aa72990193cafd P 0b9aca0aafaa43e7998ee8f3e59627e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 13:34:14.203176 10490 leader_election.cc:288] T 9417f147a78e41728d00594b19828f18 P 14f62bf285c448b9b7a21fabd7a5f0bf [CANDIDATE]: Term 7 election: Requested vote from peers 0b9aca0aafaa43e7998ee8f3e59627e0 (127.3.187.194:42569), 737c581af06a42df94970a1542600159 (127.3.187.195:43427)
I20260807 13:34:14.222873 10426 consensus_queue.cc:1046] T f3bf6b4114cb4a07b86da2385fa903bc P d6b8ccce5b91423b8673ddfbbf2c1b1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260807 13:34:14.198913 10506 consensus_queue.cc:260] T 865420f31e38417a929d1a0f5c2009ac P 14f62bf285c448b9b7a21fabd7a5f0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14f62bf285c448b9b7a21fabd7a5f0bf" member_type: VOTER last_known_addr { host: "127.3.187.193" port: 39143 } } peers { permanent_uuid: "0b9aca0aafaa43e7998ee8f3e59627e0" member_type: VOTER last_known_addr { host: "127.3.187.194" port: 42569 } } peers { permanent_uuid: "737c581af06a42df94970a1542600159" member_type: VOTER last_known_addr { host: "127.3.187.195"